Sep 22 22:57:07 devstack cinder-volume[76199]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76199) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 22 22:57:07 devstack cinder-volume[76199]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76199) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 22 22:57:07 devstack cinder-volume[76199]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76199) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 22 22:57:09 devstack cinder-volume[76199]: INFO dbcounter [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Registered counter for database cinder
Sep 22 22:57:09 devstack cinder-volume[76199]: DEBUG oslo_db.sqlalchemy.engines [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76199) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 22 22:57:09 devstack cinder-volume[76199]: DEBUG dbcounter [-] [76199] Writer thread running {{(pid=76199) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 22 22:57:09 devstack cinder-volume[76199]: INFO cinder.rpc [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 22 22:57:09 devstack cinder-volume[76199]: INFO cinder.rpc [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 22 22:57:09 devstack cinder-volume[76199]: DEBUG oslo_db.sqlalchemy.engines [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76199) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 22 22:57:09 devstack cinder-volume[76199]: INFO cinder.volume.manager [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Determined volume DB was empty at startup.
Sep 22 22:57:09 devstack cinder-volume[76199]: DEBUG cinder.volume.manager [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76199) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 22 22:57:09 devstack cinder-volume[76199]: INFO cinder.volume.manager [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 22 22:57:09 devstack cinder-volume[76199]: WARNING stevedore.named [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 22 22:57:09 devstack cinder-volume[76199]: WARNING castellan.key_manager [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 22 22:57:09 devstack cinder-volume[76199]: WARNING cinder.keymgr.conf_key_mgr [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 22 22:57:09 devstack cinder-volume[76199]: DEBUG cinder.volume.drivers.lvm [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76199) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 22 22:57:09 devstack cinder-volume[76199]: DEBUG oslo_concurrency.processutils [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_concurrency.processutils [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] CMD "cinder-rtstool verify" returned: 0 in 1.051s {{(pid=76199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_db.sqlalchemy.engines [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76199) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 22 22:57:11 devstack cinder-volume[76199]: INFO cinder.rpc [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 22 22:57:11 devstack cinder-volume[76199]: INFO cinder.rpc [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 22 22:57:11 devstack cinder-volume[76199]: WARNING stevedore.named [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 22 22:57:11 devstack cinder-volume[76199]: WARNING castellan.key_manager [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 22 22:57:11 devstack cinder-volume[76199]: INFO cinder.volume.manager [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_db.sqlalchemy.engines [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76199) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 22 22:57:11 devstack cinder-volume[76199]: INFO oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Starting 1 workers
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Started child 76300 {{(pid=76199) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Full set of CONF: {{(pid=76199) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] ******************************************************************************** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Configuration options gathered from: {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] ================================================================================ {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] allow_availability_zone_fallback = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] allow_compression_on_image_upload = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] allowed_direct_url_schemes     = [] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] api_rate_limit                 = True {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] auth_strategy                  = keystone {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] az_cache_duration              = 3600 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_availability_zone      = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_host                   = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_name                   = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_stats_polling_interval = 60 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backup_api_class               = cinder.backup.api.API {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backup_name_template           = backup-%s {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backup_use_same_host           = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backup_use_temp_snapshot       = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] chap_password                  = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] chap_username                  =  {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76300]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0)
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cinder_internal_tenant_project_id = af7208a5ce484180a184ff0bcc323ef1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cinder_internal_tenant_user_id = 22d7c22447d5411d884c21dddf4c82e7 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cloned_volume_same_az          = True {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cluster                        = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] compression_format             = gzip {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] compute_api_class              = cinder.compute.nova.API {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] config_dir                     = [] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] config_source                  = [] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] control_exchange               = openstack {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] debug                          = True {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] default_availability_zone      = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] default_group_type             = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] default_volume_type            = lvmdriver-1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] driver_client_cert             = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] driver_client_cert_key         = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] driver_data_namespace          = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] driver_ssl_cert_path           = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] driver_ssl_cert_verify         = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] driver_use_ssl                 = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] enable_force_upload            = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] enable_new_services            = True {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] enable_unsupported_driver      = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] enforce_multipath_for_image_xfer = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] filter_function                = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] glance_api_insecure            = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] glance_api_servers             = ['http://192.168.122.128/image'] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] glance_api_ssl_compression     = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] glance_ca_certificates_file    = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] glance_catalog_info            = image:glance:publicURL {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] glance_certfile                = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] glance_keyfile                 = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] glance_num_retries             = 3 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] glance_request_timeout         = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] goodness_function              = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] graceful_shutdown_timeout      = 5 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] group_api_class                = cinder.group.api.API {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] host                           = devstack {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] image_compress_on_upload       = True {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] image_conversion_address_space_limit = 1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] image_conversion_cpu_limit     = 60 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] image_conversion_disable       = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] image_upload_use_cinder_backend = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] image_upload_use_internal_tenant = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] image_volume_cache_enabled     = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] image_volume_cache_max_count   = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] image_volume_cache_max_size_gb = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] init_host_max_objects_retrieval = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:11 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] iscsi_iotype                   = fileio {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] iscsi_target_flags             =  {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] iscsi_write_cache              = on {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] iser_helper                    = tgtadm {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] iser_ip_address                = 192.168.122.128 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] iser_port                      = 3260 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] log_color                      = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] log_config_append              = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] log_dir                        = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] log_file                       = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] log_options                    = True {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] log_rotate_interval            = 1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] log_rotate_interval_type       = days {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] log_rotation_type              = none {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] max_age                        = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] max_logfile_count              = 30 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] max_logfile_size_mb            = 200 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] max_over_subscription_ratio    = 20.0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] message_reap_interval          = 86400 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] message_ttl                    = 2592000 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] migration_create_volume_timeout_secs = 300 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] monkey_patch                   = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] monkey_patch_modules           = [] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] my_ip                          = 192.168.122.128 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] no_snapshot_gb_quota           = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] num_iser_scan_tries            = 3 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] num_shell_tries                = 3 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] num_volume_device_scan_tries   = 3 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] nvmeof_conn_info_version       = 1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] nvmet_ns_id                    = 10 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] nvmet_port_id                  = 1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] osapi_max_limit                = 1000 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] osapi_volume_ext_list          = [] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] osapi_volume_listen_port       = 8776 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] osapi_volume_use_ssl           = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] osapi_volume_workers           = 2 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] per_volume_size_limit          = -1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] periodic_fuzzy_delay           = 60 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] periodic_interval              = 60 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] public_endpoint                = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] publish_errors                 = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] quota_backup_gigabytes         = 1000 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] quota_backups                  = 10 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] quota_gigabytes                = 1000 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] quota_groups                   = 10 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] quota_snapshots                = 10 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] quota_volumes                  = 10 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] rate_limit_burst               = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] rate_limit_except_level        = CRITICAL {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] rate_limit_interval            = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] reinit_driver_count            = 3 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] replication_device             = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] report_discard_supported       = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] report_interval                = 120 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] reservation_clean_interval     = 86400 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] reservation_expire             = 86400 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] reserved_image_namespaces      = [] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] reserved_percentage            = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] rpc_response_timeout           = 120 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] run_external_periodic_tasks    = True {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] scst_target_driver             = iscsi {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] scst_target_iqn_name           = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] service_down_time              = 720 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] shell_completion               = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] snapshot_name_template         = snapshot-%s {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] snapshot_same_host             = True {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] split_loggers                  = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] state_path                     = /opt/stack/data/cinder {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] storage_availability_zone      = nova {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] storage_protocol               = iSCSI {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] syslog_log_facility            = LOG_USER {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] target_helper                  = lioadm {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] target_ip_address              = 192.168.122.128 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] target_port                    = 3260 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] target_protocol                = iscsi {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] target_secondary_ip_addresses  = [] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] trace_flags                    = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] transport_url                  = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] until_refresh                  = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] use_chap_auth                  = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] use_default_quota_class        = True {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] use_journal                    = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] use_json                       = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] use_multipath_for_image_xfer   = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] use_stderr                     = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] use_syslog                     = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] verify_glance_signatures       = enabled {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] volume_api_class               = cinder.volume.api.API {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] volume_backend_name            = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] volume_clear                   = zero {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] volume_clear_ionice            = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] volume_clear_size              = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] volume_copy_bps_limit          = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] volume_dd_blocksize            = 1M {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] volume_name_template           = volume-%s {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] volume_service_inithost_offload = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] volume_usage_audit_period      = month {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] watch_log_file                 = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] zoning_mode                    = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_concurrency.disable_process_locking = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.admin_password = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.admin_token = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.admin_user  = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.auth_port   = 35357 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.auth_protocol = https {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.auth_section = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.auth_type   = password {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.auth_uri    = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.auth_version = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.cache       = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.certfile    = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.identity_uri = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.include_service_catalog = True {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.insecure    = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.interface   = public {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.keyfile     = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.memcache_password =  {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.memcache_username =  {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.region_name = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.service_token_roles_required = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.service_type = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.backend                  = dogpile.cache.null {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.backend_argument         = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.backend_expiration_time  = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.config_prefix            = cache.oslo {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.dead_timeout             = 60.0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.debug_cache_backend      = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.enable_retry_client      = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.enable_socket_keepalive  = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.enabled                  = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.enforce_fips_mode        = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.expiration_time          = 600 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.hashclient_retry_attempts = 2 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.memcache_dead_retry      = 300 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.memcache_password        = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.memcache_sasl_enabled    = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.memcache_username        = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.proxies                  = [] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.redis_db                 = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.redis_password           = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.redis_server             = localhost:6379 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.redis_socket_timeout     = 1.0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.redis_username           = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.retry_attempts           = 2 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.retry_delay              = 0.0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.socket_keepalive_count   = 1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.socket_keepalive_idle    = 1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.socket_keepalive_interval = 1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.tls_allowed_ciphers      = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.tls_cafile               = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.tls_certfile             = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.tls_enabled              = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cache.tls_keyfile              = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] coordination.backend_url       = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.asyncio_connection    = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.asyncio_slave_connection = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.backend               = sqlalchemy {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.connection            = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.connection_debug      = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.connection_parameters =  {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.connection_recycle_time = 3600 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.connection_trace      = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.db_inc_retry_interval = True {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.db_max_retries        = 20 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.db_max_retry_interval = 10 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.db_retry_interval     = 1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.max_overflow          = 50 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.max_pool_size         = 5 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.max_retries           = 10 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.mysql_wsrep_sync_wait = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.pool_timeout          = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.retry_interval        = 10 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.slave_connection      = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.sqlite_synchronous    = True {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] database.use_db_reconnect      = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] profiler.connection_string     = messaging:// {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] profiler.enabled               = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] profiler.es_doc_type           = notification {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] profiler.es_scroll_size        = 10000 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] profiler.es_scroll_time        = 2m {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] profiler.filter_error_trace    = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] profiler.hmac_keys             = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] profiler.sentinel_service_name = mymaster {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] profiler.socket_timeout        = 0.1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] profiler.trace_requests        = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] profiler.trace_sqlalchemy      = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] profiler_jaeger.process_tags   = {} {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] profiler_jaeger.service_name_prefix = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] profiler_otlp.service_name_prefix = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_policy.enforce_new_defaults = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: WARNING oslo_config.cfg [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_policy.enforce_scope      = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_policy.policy_default_rule = default {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] privsep_osbrick.group          = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] privsep_osbrick.helper_command = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] privsep_osbrick.user           = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cinder_sys_admin.group         = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cinder_sys_admin.helper_command = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] cinder_sys_admin.user          = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] service_user.auth_section      = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] service_user.auth_type         = password {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] service_user.certfile          = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] service_user.collect_timing    = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] service_user.insecure          = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] service_user.keyfile           = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] service_user.send_service_user_token = True {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] service_user.split_loggers     = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] service_user.timeout           = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] glance.auth_section            = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] glance.auth_type               = password {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] glance.certfile                = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] glance.collect_timing          = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] glance.insecure                = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] glance.keyfile                 = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] glance.split_loggers           = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] glance.timeout                 = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.backend_availability_zone = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.chap_password = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.chap_username =  {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.driver_client_cert = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.driver_client_cert_key = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.driver_data_namespace = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.driver_use_ssl = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.extra_capabilities = {} {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.filter_function = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.goodness_function = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76300]: INFO cinder.volume.manager [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.iscsi_target_flags =  {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.iscsi_write_cache = on {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.iser_helper   = tgtadm {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.iser_ip_address = 192.168.122.128 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.iser_port     = 3260 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.lvm_share_target = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.lvm_type      = auto {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.num_shell_tries = 3 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.replication_device = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.report_discard_supported = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.reserved_percentage = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.target_helper = tgtadm {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.target_ip_address = 192.168.122.128 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.target_port   = 3260 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.target_protocol = iscsi {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.trace_flags   = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.unique_fqdn_network = True {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.use_chap_auth = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.volume_backend_name = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.volume_clear  = zero {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.volume_clear_ionice = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.volume_clear_size = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_reports.file_event_handler = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_reports.log_dir           = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.backend_host       = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.chap_password      = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.chap_username      = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.driver_client_cert = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.extra_capabilities = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.filter_function    = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.goodness_function  = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.iscsi_iotype       = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.iser_helper        = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.iser_ip_address    = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.iser_port          = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.lvm_share_target   = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.lvm_type           = auto {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.num_shell_tries    = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.replication_device = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.report_discard_supported = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.reserved_percentage = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.scst_target_driver = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.storage_protocol   = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.target_helper      = lioadm {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.target_ip_address  = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.target_port        = 3260 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.trace_flags        = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.use_chap_auth      = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.volume_clear       = zero {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.volume_clear_size  = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] lvmdriver-1.volumes_dir        = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_notifications.driver = [] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_notifications.retry = -1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] key_manager.fixed_key          = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.173s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican.barbican_api_version  = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican.barbican_endpoint     = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican.barbican_endpoint_type = public {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican.barbican_region_name  = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican.cafile                = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican.certfile              = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican.collect_timing        = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican.insecure              = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican.keyfile               = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican.number_of_retries     = 60 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican.retry_delay           = 1 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican.send_service_user_token = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican.split_loggers         = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican.timeout               = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican.verify_ssl            = True {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican.verify_ssl_path       = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican_service_user.auth_section = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican_service_user.auth_type = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican_service_user.cafile   = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican_service_user.certfile = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican_service_user.collect_timing = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican_service_user.insecure = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican_service_user.keyfile  = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican_service_user.split_loggers = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] barbican_service_user.timeout  = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] vault.approle_role_id          = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] vault.approle_secret_id        = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] vault.kv_mountpoint            = secret {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] vault.kv_path                  = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] vault.kv_version               = 2 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] vault.namespace                = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] vault.root_token_id            = **** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] vault.ssl_ca_crt_file          = None {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] vault.timeout                  = 60.0 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] vault.use_ssl                  = False {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 22:57:12 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] ******************************************************************************** {{(pid=76199) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 22 22:57:12 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:12 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.117s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:13 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:13 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.096s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:13 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:13 devstack sudo[76332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 22 22:57:13 devstack sudo[76332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:57:15 devstack sudo[76332]: pam_unix(sudo:session): session closed for user root
Sep 22 22:57:15 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.319s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:15 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:15 devstack sudo[76484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 22:57:15 devstack sudo[76484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:57:17 devstack sudo[76484]: pam_unix(sudo:session): session closed for user root
Sep 22 22:57:17 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 2.029s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:17 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 22:57:17 devstack cinder-volume[76300]: INFO cinder.brick.local_dev.lvm [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 22 22:57:17 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:17 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.080s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:17 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:17 devstack sudo[76581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 22:57:17 devstack sudo[76581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:57:19 devstack sudo[76581]: pam_unix(sudo:session): session closed for user root
Sep 22 22:57:19 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.942s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:19 devstack cinder-volume[76300]: DEBUG cinder.brick.local_dev.lvm [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76300) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Sep 22 22:57:19 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:19 devstack sudo[76670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 22:57:19 devstack sudo[76670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:57:21 devstack cinder-volume[76199]: DEBUG dbcounter [-] [76199] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76199) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 22:57:22 devstack sudo[76670]: pam_unix(sudo:session): session closed for user root
Sep 22 22:57:22 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.375s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:23 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:23 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.086s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:23 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:23 devstack sudo[76867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 22:57:23 devstack sudo[76867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:57:25 devstack sudo[76867]: pam_unix(sudo:session): session closed for user root
Sep 22 22:57:25 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.076s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:25 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:25 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.072s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:25 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:25 devstack sudo[76905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 22 22:57:25 devstack sudo[76905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:57:27 devstack sudo[76905]: pam_unix(sudo:session): session closed for user root
Sep 22 22:57:27 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.014s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:27 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:27 devstack sudo[76941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 22:57:27 devstack sudo[76941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:57:30 devstack sudo[76941]: pam_unix(sudo:session): session closed for user root
Sep 22 22:57:30 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.943s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:30 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:30 devstack sudo[77030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 22:57:30 devstack sudo[77030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:57:32 devstack sudo[77030]: pam_unix(sudo:session): session closed for user root
Sep 22 22:57:32 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.260s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:32 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:32 devstack sudo[77033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 22:57:32 devstack sudo[77033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:57:35 devstack sudo[77033]: pam_unix(sudo:session): session closed for user root
Sep 22 22:57:35 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.822s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:35 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:35 devstack sudo[77038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 22:57:35 devstack sudo[77038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:57:38 devstack sudo[77038]: pam_unix(sudo:session): session closed for user root
Sep 22 22:57:38 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.604s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:38 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:38 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.256s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:38 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:38 devstack sudo[77074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 22:57:38 devstack sudo[77074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:57:41 devstack sudo[77074]: pam_unix(sudo:session): session closed for user root
Sep 22 22:57:41 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.654s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:41 devstack cinder-volume[76300]: INFO cinder.volume.drivers.lvm [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 22 22:57:41 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:41 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.088s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:41 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:41 devstack sudo[77102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 22:57:41 devstack sudo[77102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:57:43 devstack sudo[77102]: pam_unix(sudo:session): session closed for user root
Sep 22 22:57:43 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.952s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:43 devstack cinder-volume[76300]: DEBUG cinder.volume.drivers.lvm [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Updating volume stats {{(pid=76300) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 22 22:57:43 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:43 devstack sudo[77199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 22:57:43 devstack sudo[77199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:57:45 devstack sudo[77199]: pam_unix(sudo:session): session closed for user root
Sep 22 22:57:45 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.963s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:45 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:45 devstack sudo[77323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 22:57:45 devstack sudo[77323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:57:47 devstack sudo[77323]: pam_unix(sudo:session): session closed for user root
Sep 22 22:57:47 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.411s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:47 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:47 devstack sudo[77342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 22:57:47 devstack sudo[77342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:57:49 devstack sudo[77342]: pam_unix(sudo:session): session closed for user root
Sep 22 22:57:49 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.968s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:49 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:49 devstack sudo[77345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 22:57:49 devstack sudo[77345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:57:51 devstack sudo[77345]: pam_unix(sudo:session): session closed for user root
Sep 22 22:57:51 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.006s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:51 devstack cinder-volume[76300]: INFO cinder.volume.driver [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Driver hasn't implemented _init_vendor_properties()
Sep 22 22:57:51 devstack cinder-volume[76300]: DEBUG cinder.volume.driver [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76300) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 22 22:57:51 devstack cinder-volume[76300]: DEBUG oslo_db.sqlalchemy.engines [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76300) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 22 22:57:51 devstack cinder-volume[76300]: DEBUG dbcounter [-] [76300] Writer thread running {{(pid=76300) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 22 22:57:52 devstack cinder-volume[76300]: DEBUG cinder.db.sqlalchemy.api [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Building query based on filter {{(pid=76300) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 22 22:57:52 devstack cinder-volume[76300]: DEBUG cinder.image.image_utils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76300) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 22 22:57:52 devstack cinder-volume[76300]: INFO cinder.keymgr.migration [None req-b54bbce8-1a06-4475-9326-d16c752dbfd3 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 22 22:57:52 devstack cinder-volume[76300]: DEBUG cinder.volume.drivers.lvm [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Updating volume stats {{(pid=76300) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 22 22:57:52 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:52 devstack sudo[77359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 22:57:52 devstack sudo[77359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:57:54 devstack sudo[77359]: pam_unix(sudo:session): session closed for user root
Sep 22 22:57:54 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.201s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:54 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:54 devstack sudo[77363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 22:57:54 devstack sudo[77363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:57:56 devstack sudo[77363]: pam_unix(sudo:session): session closed for user root
Sep 22 22:57:56 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.944s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:56 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:56 devstack sudo[77459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 22:57:56 devstack sudo[77459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:57:58 devstack sudo[77459]: pam_unix(sudo:session): session closed for user root
Sep 22 22:57:58 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.111s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:57:58 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:57:58 devstack sudo[77509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 22:57:58 devstack sudo[77509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:58:00 devstack sudo[77509]: pam_unix(sudo:session): session closed for user root
Sep 22 22:58:00 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.263s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:58:00 devstack cinder-volume[76300]: DEBUG cinder.manager [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Notifying Schedulers of capabilities ... {{(pid=76300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 22:58:00 devstack cinder-volume[76300]: INFO cinder.volume.manager [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Driver initialization completed successfully.
Sep 22 22:58:00 devstack cinder-volume[76300]: INFO cinder.manager [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Initiating service 2 cleanup
Sep 22 22:58:01 devstack cinder-volume[76300]: INFO cinder.manager [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Service 2 cleanup completed.
Sep 22 22:58:01 devstack cinder-volume[76300]: DEBUG cinder.service [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Creating RPC server for service cinder-volume {{(pid=76300) start /opt/stack/cinder/cinder/service.py:239}}
Sep 22 22:58:01 devstack cinder-volume[76300]: DEBUG cinder.service [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76300) start /opt/stack/cinder/cinder/service.py:245}}
Sep 22 22:58:01 devstack cinder-volume[76300]: INFO cinder.volume.manager [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 22 22:58:01 devstack cinder-volume[76300]: DEBUG cinder.volume.drivers.lvm [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Updating volume stats {{(pid=76300) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 22 22:58:01 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:58:01 devstack sudo[77515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 22:58:01 devstack sudo[77515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:58:03 devstack sudo[77515]: pam_unix(sudo:session): session closed for user root
Sep 22 22:58:03 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.958s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:58:03 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:58:03 devstack sudo[77518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 22:58:03 devstack sudo[77518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:58:05 devstack sudo[77518]: pam_unix(sudo:session): session closed for user root
Sep 22 22:58:05 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.947s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:58:05 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:58:05 devstack sudo[77526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 22:58:05 devstack sudo[77526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:58:07 devstack sudo[77526]: pam_unix(sudo:session): session closed for user root
Sep 22 22:58:07 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.923s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:58:07 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:58:07 devstack sudo[77529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 22:58:07 devstack sudo[77529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:58:09 devstack sudo[77529]: pam_unix(sudo:session): session closed for user root
Sep 22 22:58:09 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.881s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:58:09 devstack cinder-volume[76300]: INFO cinder.volume.manager [None req-360bfd91-f139-45fc-b58a-872c35d95378 None None] Driver post RPC initialization completed successfully.
Sep 22 22:58:11 devstack cinder-volume[76300]: DEBUG dbcounter [-] [76300] Writing DB stats cinder:SELECT=1 {{(pid=76300) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 22:58:19 devstack cinder-volume[76300]: DEBUG dbcounter [-] [76300] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76300) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 22:58:38 devstack cinder-volume[76300]: DEBUG oslo_service.periodic_task [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76300) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 22:58:38 devstack cinder-volume[76300]: DEBUG cinder.volume.drivers.lvm [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Updating volume stats {{(pid=76300) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 22 22:58:38 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:58:38 devstack sudo[78395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 22:58:38 devstack sudo[78395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:58:40 devstack sudo[78395]: pam_unix(sudo:session): session closed for user root
Sep 22 22:58:40 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.201s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:58:40 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:58:40 devstack sudo[78496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 22:58:40 devstack sudo[78496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:58:42 devstack sudo[78496]: pam_unix(sudo:session): session closed for user root
Sep 22 22:58:42 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.214s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:58:42 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:58:42 devstack sudo[78502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 22:58:42 devstack sudo[78502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:58:45 devstack sudo[78502]: pam_unix(sudo:session): session closed for user root
Sep 22 22:58:45 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.220s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:58:45 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:58:45 devstack sudo[78505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 22:58:45 devstack sudo[78505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:58:46 devstack sudo[78505]: pam_unix(sudo:session): session closed for user root
Sep 22 22:58:47 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.941s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:58:47 devstack cinder-volume[76300]: DEBUG cinder.manager [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Notifying Schedulers of capabilities ... {{(pid=76300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 22:59:38 devstack cinder-volume[76300]: DEBUG oslo_service.periodic_task [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76300) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 22:59:38 devstack cinder-volume[76300]: DEBUG cinder.volume.drivers.lvm [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Updating volume stats {{(pid=76300) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 22 22:59:38 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:59:38 devstack sudo[79102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 22:59:38 devstack sudo[79102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:59:40 devstack sudo[79102]: pam_unix(sudo:session): session closed for user root
Sep 22 22:59:40 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.027s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:59:40 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:59:40 devstack sudo[79106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 22:59:40 devstack sudo[79106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:59:42 devstack sudo[79106]: pam_unix(sudo:session): session closed for user root
Sep 22 22:59:42 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.419s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:59:42 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:59:42 devstack sudo[79141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 22:59:42 devstack sudo[79141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:59:44 devstack sudo[79141]: pam_unix(sudo:session): session closed for user root
Sep 22 22:59:44 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.873s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:59:44 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 22:59:44 devstack sudo[79208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 22:59:44 devstack sudo[79208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 22:59:46 devstack sudo[79208]: pam_unix(sudo:session): session closed for user root
Sep 22 22:59:46 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.991s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 22:59:46 devstack cinder-volume[76300]: DEBUG cinder.manager [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Notifying Schedulers of capabilities ... {{(pid=76300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:00:19 devstack cinder-volume[76300]: DEBUG dbcounter [-] [76300] Writing DB stats cinder:SELECT=1 {{(pid=76300) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:00:19 devstack cinder-volume[76300]: DEBUG dbcounter [-] [76300] Writing DB stats cinder:UPDATE=1 {{(pid=76300) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:00:38 devstack cinder-volume[76300]: DEBUG oslo_service.periodic_task [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76300) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:00:38 devstack cinder-volume[76300]: DEBUG cinder.volume.drivers.lvm [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Updating volume stats {{(pid=76300) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 22 23:00:38 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:00:38 devstack sudo[79914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 23:00:38 devstack sudo[79914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:00:40 devstack sudo[79914]: pam_unix(sudo:session): session closed for user root
Sep 22 23:00:40 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.012s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:00:40 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:00:40 devstack sudo[79918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 23:00:40 devstack sudo[79918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:00:42 devstack sudo[79918]: pam_unix(sudo:session): session closed for user root
Sep 22 23:00:42 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.714s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:00:42 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:00:42 devstack sudo[79921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 23:00:42 devstack sudo[79921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:00:44 devstack sudo[79921]: pam_unix(sudo:session): session closed for user root
Sep 22 23:00:44 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.454s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:00:44 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:00:44 devstack sudo[80104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 23:00:44 devstack sudo[80104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:00:46 devstack sudo[80104]: pam_unix(sudo:session): session closed for user root
Sep 22 23:00:46 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.020s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:00:46 devstack cinder-volume[76300]: DEBUG cinder.manager [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Notifying Schedulers of capabilities ... {{(pid=76300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:01:38 devstack cinder-volume[76300]: DEBUG oslo_service.periodic_task [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76300) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:01:38 devstack cinder-volume[76300]: DEBUG cinder.volume.drivers.lvm [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Updating volume stats {{(pid=76300) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 22 23:01:38 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:01:38 devstack sudo[82452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 23:01:38 devstack sudo[82452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:01:40 devstack sudo[82452]: pam_unix(sudo:session): session closed for user root
Sep 22 23:01:40 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.957s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:01:40 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:01:40 devstack sudo[82462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 23:01:40 devstack sudo[82462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:01:42 devstack sudo[82462]: pam_unix(sudo:session): session closed for user root
Sep 22 23:01:42 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.778s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:01:42 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:01:42 devstack sudo[82472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 23:01:42 devstack sudo[82472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:01:44 devstack sudo[82472]: pam_unix(sudo:session): session closed for user root
Sep 22 23:01:44 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.959s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:01:44 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:01:44 devstack sudo[82489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 23:01:44 devstack sudo[82489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:01:45 devstack sudo[82489]: pam_unix(sudo:session): session closed for user root
Sep 22 23:01:46 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.966s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:01:46 devstack cinder-volume[76300]: DEBUG cinder.manager [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Notifying Schedulers of capabilities ... {{(pid=76300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:02:19 devstack cinder-volume[76300]: DEBUG dbcounter [-] [76300] Writing DB stats cinder:SELECT=1 {{(pid=76300) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:02:19 devstack cinder-volume[76300]: DEBUG dbcounter [-] [76300] Writing DB stats cinder:UPDATE=1 {{(pid=76300) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:02:38 devstack cinder-volume[76300]: DEBUG oslo_service.periodic_task [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76300) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:02:38 devstack cinder-volume[76300]: DEBUG cinder.volume.drivers.lvm [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Updating volume stats {{(pid=76300) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 22 23:02:38 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:02:38 devstack sudo[82743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 23:02:38 devstack sudo[82743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:02:40 devstack sudo[82743]: pam_unix(sudo:session): session closed for user root
Sep 22 23:02:40 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.044s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:02:40 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:02:40 devstack sudo[82747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 23:02:40 devstack sudo[82747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:02:42 devstack sudo[82747]: pam_unix(sudo:session): session closed for user root
Sep 22 23:02:42 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.096s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:02:42 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:02:42 devstack sudo[82750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 23:02:42 devstack sudo[82750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:02:44 devstack sudo[82750]: pam_unix(sudo:session): session closed for user root
Sep 22 23:02:44 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.856s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:02:44 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:02:44 devstack sudo[82753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 23:02:44 devstack sudo[82753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:02:46 devstack sudo[82753]: pam_unix(sudo:session): session closed for user root
Sep 22 23:02:46 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.295s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:02:46 devstack cinder-volume[76300]: DEBUG cinder.manager [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Notifying Schedulers of capabilities ... {{(pid=76300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:03:38 devstack cinder-volume[76300]: DEBUG oslo_service.periodic_task [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76300) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:03:38 devstack cinder-volume[76300]: DEBUG cinder.volume.drivers.lvm [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Updating volume stats {{(pid=76300) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 22 23:03:38 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:03:38 devstack sudo[83632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 22 23:03:38 devstack sudo[83632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:03:40 devstack sudo[83632]: pam_unix(sudo:session): session closed for user root
Sep 22 23:03:40 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.472s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:03:40 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:03:40 devstack sudo[83667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 23:03:40 devstack sudo[83667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:03:41 devstack cinder-volume[76199]: INFO oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Caught SIGTERM, stopping children
Sep 22 23:03:41 devstack cinder-volume[76199]: DEBUG oslo_concurrency.lockutils [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Acquiring lock "singleton_lock" {{(pid=76199) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 22 23:03:41 devstack cinder-volume[76199]: DEBUG oslo_concurrency.lockutils [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Acquired lock "singleton_lock" {{(pid=76199) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 22 23:03:41 devstack cinder-volume[76199]: DEBUG oslo_concurrency.lockutils [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Releasing lock "singleton_lock" {{(pid=76199) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 22 23:03:41 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Stop services. {{(pid=76199) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 22 23:03:41 devstack cinder-volume[76199]: DEBUG oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Killing children. {{(pid=76199) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 22 23:03:41 devstack cinder-volume[76199]: INFO oslo_service.backend._eventlet.service [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Waiting on 1 children to exit
Sep 22 23:03:44 devstack sudo[83667]: pam_unix(sudo:session): session closed for user root
Sep 22 23:03:44 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 4.115s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:03:44 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:03:45 devstack sudo[83724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 22 23:03:45 devstack sudo[83724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:03:46 devstack cinder-volume[76300]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Sep 22 23:03:53 devstack sudo[83724]: pam_unix(sudo:session): session closed for user root
Sep 22 23:03:53 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 8.407s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:03:53 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:03:53 devstack sudo[83906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 22 23:03:53 devstack sudo[83906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:04:00 devstack sudo[83906]: pam_unix(sudo:session): session closed for user root
Sep 22 23:04:00 devstack cinder-volume[76300]: DEBUG oslo_concurrency.processutils [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 7.047s {{(pid=76300) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:04:00 devstack cinder-volume[76300]: DEBUG cinder.manager [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Notifying Schedulers of capabilities ... {{(pid=76300) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Unable to connect to AMQP server on 192.168.122.128:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task [None req-0ac1db22-f887-49f4-9246-f35b3197ac94 None None] Error during VolumeManager.publish_service_capabilities: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.128:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task Traceback (most recent call last):
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1173, in ensure
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     ret, channel = autoretry_method()
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 556, in _ensured
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     return fun(*args, **kwargs)
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 639, in __call__
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     return fun(*args, channel=channels[0], **kwargs), channels[0]
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1162, in execute_method
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     method()
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1624, in _publish
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     self._producer.publish(
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 190, in publish
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     return _publish(
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 214, in _publish
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     return channel.basic_publish(
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     self.wait([spec.Basic.Ack, spec.Basic.Nack],
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 99, in wait
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     self.connection.drain_events(timeout=timeout)
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 526, in drain_events
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     while not self.blocking_read(timeout):
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 532, in blocking_read
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     return self.on_inbound_frame(frame)
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/method_framing.py", line 53, in on_frame
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     callback(channel, method_sig, buf, None)
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 538, in on_inbound_method
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     return self.channels[channel_id].dispatch_method(
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     listener(*args)
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 293, in _on_close
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     raise error_for_code(
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task 
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task 
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task Traceback (most recent call last):
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     task(self, context)
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/cinder/cinder/volume/manager.py", line 2873, in publish_service_capabilities
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     self._publish_service_capabilities(context)
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/cinder/cinder/manager.py", line 203, in _publish_service_capabilities
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     self.scheduler_rpcapi.update_service_capabilities(
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     cctxt.cast(ctxt, 'update_service_capabilities', **msg_args)
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 154, in cast
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     self.transport._send(self.target, msg_ctxt, msg,
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     return self._driver.send(target, ctxt, message,
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     return self._send(target, ctxt, message, wait_for_reply, timeout,
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     conn.fanout_send(target.topic, msg, retry=retry)
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1743, in fanout_send
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     self._ensure_publishing(self._publish, exchange, msg, retry=retry)
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1575, in _ensure_publishing
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     self.ensure(method, retry=retry, error_callback=_error_callback)
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1195, in ensure
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task     raise exceptions.MessageDeliveryFailure(msg)
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.128:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 22 23:04:00 devstack cinder-volume[76300]: ERROR oslo_service.periodic_task 
Sep 22 23:04:00 devstack cinder-volume[76300]: DEBUG oslo_concurrency.lockutils [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Acquiring lock "singleton_lock" {{(pid=76300) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 22 23:04:00 devstack cinder-volume[76300]: DEBUG oslo_concurrency.lockutils [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Acquired lock "singleton_lock" {{(pid=76300) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 22 23:04:00 devstack cinder-volume[76300]: DEBUG oslo_concurrency.lockutils [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Releasing lock "singleton_lock" {{(pid=76300) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 22 23:04:00 devstack cinder-volume[76300]: WARNING amqp [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 22 23:04:00 devstack cinder-volume[76300]: WARNING amqp [None req-7fc24598-991a-49f4-9fac-e2be7babf3c8 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 22 23:04:08 devstack cinder-volume[83741]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83741) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 22 23:04:08 devstack cinder-volume[83741]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83741) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 22 23:04:08 devstack cinder-volume[83741]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83741) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 22 23:04:10 devstack cinder-volume[83741]: INFO dbcounter [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] Registered counter for database cinder
Sep 22 23:04:11 devstack cinder-volume[83741]: DEBUG oslo_db.sqlalchemy.engines [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 22 23:04:11 devstack cinder-volume[83741]: DEBUG dbcounter [-] [83741] Writer thread running {{(pid=83741) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 22 23:04:11 devstack cinder-volume[83741]: INFO cinder.rpc [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 22 23:04:11 devstack cinder-volume[83741]: INFO cinder.rpc [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 22 23:04:11 devstack cinder-volume[83741]: DEBUG oslo_db.sqlalchemy.engines [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 22 23:04:11 devstack cinder-volume[83741]: INFO cinder.volume.manager [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] Determined volume DB was empty at startup.
Sep 22 23:04:11 devstack cinder-volume[83741]: DEBUG cinder.volume.manager [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83741) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 22 23:04:11 devstack cinder-volume[83741]: INFO cinder.volume.manager [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 22 23:04:11 devstack cinder-volume[83741]: WARNING stevedore.named [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 22 23:04:11 devstack cinder-volume[83741]: WARNING castellan.key_manager [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 22 23:04:11 devstack cinder-volume[83741]: WARNING cinder.keymgr.conf_key_mgr [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 22 23:04:12 devstack cinder-volume[83741]: INFO cinder.volume.manager [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 22 23:04:12 devstack cinder-volume[83741]: DEBUG oslo_db.sqlalchemy.engines [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 22 23:04:12 devstack cinder-volume[83741]: INFO oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] Starting 1 workers
Sep 22 23:04:12 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] Started child 84012 {{(pid=83741) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 22 23:04:12 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] Full set of CONF: {{(pid=83741) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 22 23:04:12 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] ******************************************************************************** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 22 23:04:12 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] Configuration options gathered from: {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 22 23:04:12 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 22 23:04:12 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] ================================================================================ {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] allow_availability_zone_fallback = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] allow_compression_on_image_upload = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[84012]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0)
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] allowed_direct_url_schemes     = [] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] api_rate_limit                 = True {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] auth_strategy                  = keystone {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_availability_zone      = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_host                   = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_name                   = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_stats_polling_interval = 60 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backup_api_class               = cinder.backup.api.API {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backup_name_template           = backup-%s {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backup_use_same_host           = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backup_use_temp_snapshot       = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] chap_password                  = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] chap_username                  =  {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cinder_internal_tenant_project_id = af7208a5ce484180a184ff0bcc323ef1 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cinder_internal_tenant_user_id = 22d7c22447d5411d884c21dddf4c82e7 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cluster                        = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] compression_format             = gzip {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] compute_api_class              = cinder.compute.nova.API {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] config_dir                     = [] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] config_source                  = [] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] control_exchange               = openstack {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] debug                          = True {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] default_availability_zone      = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] default_group_type             = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] default_volume_type            = QuobyteHD {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] driver_client_cert             = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] driver_client_cert_key         = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] driver_data_namespace          = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] driver_ssl_cert_path           = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] driver_ssl_cert_verify         = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] driver_use_ssl                 = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] enable_new_services            = True {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] enable_unsupported_driver      = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] enabled_backends               = ['QuobyteHD'] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] enforce_multipath_for_image_xfer = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] filter_function                = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] glance_api_insecure            = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] glance_api_servers             = ['http://192.168.122.128/image'] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] glance_api_ssl_compression     = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] glance_ca_certificates_file    = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] glance_catalog_info            = image:glance:publicURL {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] glance_certfile                = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] glance_keyfile                 = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] glance_num_retries             = 3 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] glance_request_timeout         = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] goodness_function              = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] graceful_shutdown_timeout      = 5 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] group_api_class                = cinder.group.api.API {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] host                           = devstack {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] image_compress_on_upload       = True {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] image_conversion_address_space_limit = 1 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] image_conversion_cpu_limit     = 60 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] image_conversion_disable       = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] image_upload_use_cinder_backend = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] image_upload_use_internal_tenant = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] image_volume_cache_enabled     = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] image_volume_cache_max_count   = 0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] image_volume_cache_max_size_gb = 0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] init_host_max_objects_retrieval = 0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] instance_format                = [instance: %(uuid)s]  {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] iscsi_iotype                   = fileio {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] iscsi_target_flags             =  {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] iscsi_write_cache              = on {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] iser_helper                    = tgtadm {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] iser_ip_address                = 192.168.122.128 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] iser_port                      = 3260 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] log_color                      = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] log_config_append              = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] log_dir                        = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] log_file                       = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] log_options                    = True {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] log_rotate_interval            = 1 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] log_rotate_interval_type       = days {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] log_rotation_type              = none {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] max_age                        = 0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] max_logfile_count              = 30 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] max_logfile_size_mb            = 200 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] max_over_subscription_ratio    = 20.0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] message_reap_interval          = 86400 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] message_ttl                    = 2592000 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] migration_create_volume_timeout_secs = 300 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] monkey_patch                   = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] monkey_patch_modules           = [] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] my_ip                          = 192.168.122.128 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] no_snapshot_gb_quota           = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] num_iser_scan_tries            = 3 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] num_shell_tries                = 3 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] num_volume_device_scan_tries   = 3 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] nvmeof_conn_info_version       = 1 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] nvmet_ns_id                    = 10 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] nvmet_port_id                  = 1 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] osapi_max_limit                = 1000 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] osapi_volume_ext_list          = [] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] osapi_volume_listen_port       = 8776 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] osapi_volume_use_ssl           = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] osapi_volume_workers           = 2 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] per_volume_size_limit          = -1 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] periodic_fuzzy_delay           = 60 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] periodic_interval              = 60 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] public_endpoint                = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] publish_errors                 = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] quota_backup_gigabytes         = 1000 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] quota_backups                  = 10 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] quota_gigabytes                = 1000 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] quota_groups                   = 10 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] quota_snapshots                = 10 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] quota_volumes                  = 10 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] rate_limit_burst               = 0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] rate_limit_except_level        = CRITICAL {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] rate_limit_interval            = 0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] reinit_driver_count            = 3 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] replication_device             = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] report_discard_supported       = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] report_interval                = 120 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] reservation_clean_interval     = 86400 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] reservation_expire             = 86400 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] reserved_image_namespaces      = [] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] reserved_percentage            = 0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] rpc_response_timeout           = 120 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] run_external_periodic_tasks    = True {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] scst_target_driver             = iscsi {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] scst_target_iqn_name           = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] service_down_time              = 720 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] shell_completion               = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] snapshot_name_template         = snapshot-%s {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] split_loggers                  = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] state_path                     = /opt/stack/data/cinder {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] storage_availability_zone      = nova {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] storage_protocol               = iSCSI {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] syslog_log_facility            = LOG_USER {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] target_helper                  = lioadm {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] target_ip_address              = 192.168.122.128 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] target_port                    = 3260 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] target_protocol                = iscsi {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] target_secondary_ip_addresses  = [] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] trace_flags                    = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] transport_url                  = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] until_refresh                  = 0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] use_chap_auth                  = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] use_default_quota_class        = True {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] use_journal                    = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] use_json                       = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] use_multipath_for_image_xfer   = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] use_stderr                     = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] use_syslog                     = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] verify_glance_signatures       = enabled {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] volume_api_class               = cinder.volume.api.API {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] volume_backend_name            = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] volume_clear                   = zero {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] volume_clear_ionice            = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] volume_clear_size              = 0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] volume_copy_bps_limit          = 0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] volume_dd_blocksize            = 1M {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] volume_name_template           = volume-%s {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] volume_service_inithost_offload = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] volume_usage_audit_period      = month {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] watch_log_file                 = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] zoning_mode                    = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_concurrency.disable_process_locking = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=84012) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.admin_password = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.admin_token = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.admin_user  = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.auth_port   = 35357 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.auth_protocol = https {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.auth_section = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.auth_type   = password {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.auth_uri    = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.auth_version = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.cache       = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.certfile    = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.delay_auth_decision = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.http_connect_timeout = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.identity_uri = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.include_service_catalog = True {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.insecure    = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.interface   = public {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.keyfile     = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.memcache_password =  {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:13 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.memcache_username =  {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.region_name = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.service_token_roles_required = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.service_type = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.token_cache_time = 300 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] keystone_authtoken.www_authenticate_uri = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.backend                  = dogpile.cache.null {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.backend_argument         = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.backend_expiration_time  = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.config_prefix            = cache.oslo {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.dead_timeout             = 60.0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.debug_cache_backend      = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.enable_retry_client      = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.enable_socket_keepalive  = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.enabled                  = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.enforce_fips_mode        = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.expiration_time          = 600 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.hashclient_retry_attempts = 2 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.hashclient_retry_delay   = 1.0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.memcache_dead_retry      = 300 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.memcache_password        = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.memcache_pool_maxsize    = 10 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.memcache_sasl_enabled    = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.memcache_socket_timeout  = 1.0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.memcache_username        = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.proxies                  = [] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.redis_db                 = 0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.redis_password           = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.redis_sentinel_service_name = mymaster {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.redis_server             = localhost:6379 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.redis_socket_timeout     = 1.0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.redis_username           = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.retry_attempts           = 2 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.retry_delay              = 0.0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.socket_keepalive_count   = 1 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.socket_keepalive_idle    = 1 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.socket_keepalive_interval = 1 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.tls_allowed_ciphers      = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.tls_cafile               = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.tls_certfile             = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.tls_enabled              = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cache.tls_keyfile              = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] coordination.backend_url       = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.asyncio_connection    = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.asyncio_slave_connection = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.backend               = sqlalchemy {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.connection            = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.connection_debug      = 0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.connection_parameters =  {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.connection_recycle_time = 3600 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.connection_trace      = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.db_inc_retry_interval = True {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.db_max_retries        = 20 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.db_max_retry_interval = 10 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.db_retry_interval     = 1 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.max_overflow          = 50 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.max_pool_size         = 5 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.max_retries           = 10 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.mysql_wsrep_sync_wait = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.pool_timeout          = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.retry_interval        = 10 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.slave_connection      = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.sqlite_synchronous    = True {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] database.use_db_reconnect      = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] profiler.connection_string     = messaging:// {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] profiler.enabled               = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] profiler.es_doc_type           = notification {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] profiler.es_scroll_size        = 10000 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] profiler.es_scroll_time        = 2m {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] profiler.filter_error_trace    = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] profiler.hmac_keys             = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] profiler.sentinel_service_name = mymaster {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] profiler.socket_timeout        = 0.1 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] profiler.trace_requests        = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] profiler.trace_sqlalchemy      = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] profiler_jaeger.process_tags   = {} {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] profiler_jaeger.service_name_prefix = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] profiler_otlp.service_name_prefix = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_policy.enforce_new_defaults = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: WARNING oslo_config.cfg [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_policy.enforce_scope      = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_policy.policy_default_rule = default {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_policy.policy_file        = policy.yaml {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] privsep_osbrick.group          = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] privsep_osbrick.helper_command = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] privsep_osbrick.thread_pool_size = 3 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] privsep_osbrick.user           = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cinder_sys_admin.group         = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cinder_sys_admin.helper_command = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] cinder_sys_admin.user          = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] service_user.auth_section      = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] service_user.auth_type         = password {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] service_user.certfile          = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] service_user.collect_timing    = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] service_user.insecure          = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] service_user.keyfile           = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] service_user.send_service_user_token = True {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] service_user.split_loggers     = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] service_user.timeout           = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] glance.auth_section            = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] glance.auth_type               = password {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] glance.certfile                = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] glance.collect_timing          = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] glance.insecure                = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] glance.keyfile                 = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] glance.split_loggers           = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] glance.timeout                 = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.backend_availability_zone = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.chap_password = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.chap_username =  {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.driver_client_cert = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.driver_client_cert_key = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.driver_data_namespace = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.driver_use_ssl = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.enable_unsupported_driver = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.extra_capabilities = {} {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.filter_function = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.goodness_function = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.iscsi_iotype  = fileio {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.iscsi_target_flags =  {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.iscsi_write_cache = on {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.iser_helper   = tgtadm {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.iser_ip_address = 192.168.122.128 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.iser_port     = 3260 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.nas_host      =  {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.nas_login     = admin {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.nas_mount_options = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.nas_password  = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.nas_private_key =  {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.nas_share_path =  {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.num_shell_tries = 3 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.nvmet_port_id = 1 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.quobyte_client_cfg = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.quobyte_volume_url = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.replication_device = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.report_discard_supported = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.reserved_percentage = 0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.scst_target_driver = iscsi {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.scst_target_iqn_name = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.storage_protocol = iSCSI {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.target_helper = tgtadm {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.target_ip_address = 192.168.122.128 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.target_port   = 3260 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.target_protocol = iscsi {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.trace_flags   = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.unique_fqdn_network = True {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.use_chap_auth = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.volume_backend_name = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.volume_clear  = zero {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.volume_clear_ionice = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.volume_clear_size = 0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_reports.file_event_handler = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_reports.log_dir           = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.backend_availability_zone = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.backend_host         = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.chap_password        = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.chap_username        = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.chiscsi_conf         = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.driver_client_cert   = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.driver_client_cert_key = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.driver_data_namespace = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.driver_use_ssl       = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.extra_capabilities   = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.filter_function      = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.goodness_function    = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.iscsi_iotype         = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.iser_helper          = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.iser_ip_address      = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.iser_port            = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.iser_target_prefix   = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.nas_host             = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.nas_login            = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.nas_mount_options    = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.nas_password         = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.nas_private_key      = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.nas_secure_file_operations = true {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.nas_share_path       = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.nas_ssh_port         = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.num_shell_tries      = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.nvmet_port_id        = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.quobyte_volume_url   = quobyte://10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.replication_device   = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.report_discard_supported = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.reserved_percentage  = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.scst_target_driver   = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.storage_protocol     = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.target_helper        = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.target_ip_address    = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.target_port          = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.target_prefix        = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.target_protocol      = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.trace_flags          = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.use_chap_auth        = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.volume_clear         = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.volume_clear_size    = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] QuobyteHD.volumes_dir          = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:14 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=84012) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 22 23:04:15 devstack cinder-volume[84012]: INFO cinder.volume.drivers.quobyte [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 22 23:04:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Running cmd (subprocess): mount.quobyte {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.ssl      = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_notifications.driver = [] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_notifications.retry = -1 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] oslo_messaging_notifications.transport_url = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] key_manager.fixed_key          = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican.barbican_api_version  = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican.barbican_endpoint     = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican.barbican_endpoint_type = public {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican.barbican_region_name  = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican.cafile                = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican.certfile              = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican.collect_timing        = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican.insecure              = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican.keyfile               = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican.number_of_retries     = 60 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican.retry_delay           = 1 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican.send_service_user_token = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican.split_loggers         = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican.timeout               = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican.verify_ssl            = True {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican.verify_ssl_path       = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican_service_user.auth_section = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican_service_user.auth_type = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican_service_user.cafile   = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican_service_user.certfile = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican_service_user.collect_timing = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican_service_user.insecure = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican_service_user.keyfile  = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican_service_user.split_loggers = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] barbican_service_user.timeout  = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] vault.approle_role_id          = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] vault.approle_secret_id        = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] vault.kv_mountpoint            = secret {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] vault.kv_path                  = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] vault.kv_version               = 2 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] vault.namespace                = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] vault.root_token_id            = **** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] vault.ssl_ca_crt_file          = None {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] vault.timeout                  = 60.0 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] vault.use_ssl                  = False {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 22 23:04:15 devstack cinder-volume[83741]: DEBUG oslo_service.backend._eventlet.service [None req-14042fac-9990-4085-8ba4-51a73c7cc1eb None None] ******************************************************************************** {{(pid=83741) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 22 23:04:16 devstack quobyte-client[84044]: Reading configuration file: /etc/quobyte/client.cfg
Sep 22 23:04:16 devstack quobyte-client[84044]: Invalid parameters found, error: missing mount point.
Sep 22 23:04:16 devstack quobyte-client[84044]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 22 23:04:16 devstack quobyte-client[84044]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 22 23:04:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] CMD "mount.quobyte" returned: 1 in 0.981s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:04:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:04:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:04:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:04:16 devstack cinder-volume[84012]: INFO cinder.volume.drivers.quobyte [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Mounting volume: 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f ...
Sep 22 23:04:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d -c /etc/quobyte/client-cinder.cfg {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:04:16 devstack quobyte-client[84063]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 22 23:04:16 devstack quobyte-client[84063]: Reading configuration file: /etc/quobyte/client.cfg
Sep 22 23:04:16 devstack quobyte-client[84063]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d' to display the log.
Sep 22 23:04:16 devstack quobyte-client[84065]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 22 23:04:16 devstack quobyte-client[84065]: mount.quobyte 3.25 (4fbbd59204)
Sep 22 23:04:16 devstack quobyte-client[84065]: Client UUID: bExugSgJ-nJhX-UMFV-pulI-siTJoSRkCulJ
Sep 22 23:04:16 devstack quobyte-client[84065]: Registry: osci01.corp.quobyte.com:7861
Sep 22 23:04:16 devstack quobyte-client[84065]: Volume: cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:04:16 devstack quobyte-client[84065]: FUSE version: 316
Sep 22 23:04:16 devstack quobyte-client[84065]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 22 23:04:16 devstack quobyte-client[84065]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 22 23:04:16 devstack quobyte-client[84065]: Setting total object cache size to 3352297472 bytes
Sep 22 23:04:16 devstack quobyte-client[84065]: Using FUSE low-level API
Sep 22 23:04:16 devstack quobyte-client[84065]: Caching of uid/gid to user/group name mappings is enabled
Sep 22 23:04:16 devstack quobyte-client[84065]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 22 23:04:16 devstack quobyte-client[84065]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab.
Sep 22 23:04:16 devstack quobyte-client[84065]: HTTP server started on port 55000
Sep 22 23:04:16 devstack quobyte-client[84065]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 22 23:04:16 devstack quobyte-client[84065]: Mount point /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d established
Sep 22 23:04:16 devstack quobyte-client[84065]: TimeSync is running and remote sync every 60 seconds
Sep 22 23:04:16 devstack quobyte-client[84065]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 22 23:04:16 devstack quobyte-client[84065]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 22 23:04:16 devstack quobyte-client[84065]: Opening volume cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f (a50e2da2-2670-46c7-aa52-a5bba043dd00)
Sep 22 23:04:16 devstack quobyte-client[84065]: Setting metadata cache size to 500000 based on available system memory of 16 GiB
Sep 22 23:04:16 devstack quobyte-client[84065]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 22 23:04:16 devstack quobyte-client[84065]: Changed metadata cache configuration for volume a50e2da2-2670-46c7-aa52-a5bba043dd00 to cache_ttl_ms: 0 negative_cache_ttl_ms: 0 enable_write_back_cache: false
Sep 22 23:04:16 devstack quobyte-client[84065]: Failed to invalidate inode: 38: Function not implemented
Sep 22 23:04:16 devstack quobyte-client[84065]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 22 23:04:16 devstack quobyte-client[84065]: Automatic minidump upload enabled by global system configuration
Sep 22 23:04:16 devstack quobyte-client[84065]: Announcing HTTP status server address 172.24.4.1
Sep 22 23:04:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.788s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:04:16 devstack quobyte-client[84065]: Registered as service (uuid bExugSgJ-nJhX-UMFV-pulI-siTJoSRkCulJ)
Sep 22 23:04:16 devstack quobyte-client[84065]: Quobyte Client running as pid 84065
Sep 22 23:04:16 devstack cinder-volume[84012]: INFO cinder.volume.drivers.quobyte [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Mounting volume: 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f succeeded
Sep 22 23:04:16 devstack quobyte-client[84065]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 22 23:04:16 devstack quobyte-client[84065]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 22 23:04:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:04:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.872s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:04:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:04:17 devstack quobyte-client[84065]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 22 23:04:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.072s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:04:17 devstack cinder-volume[84012]: INFO cinder.volume.driver [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Driver hasn't implemented _init_vendor_properties()
Sep 22 23:04:17 devstack cinder-volume[84012]: DEBUG cinder.volume.driver [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154739379883, 'free_capacity_gb': 924.9154739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84012) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 22 23:04:17 devstack cinder-volume[84012]: DEBUG oslo_db.sqlalchemy.engines [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84012) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 22 23:04:17 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writer thread running {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 22 23:04:17 devstack cinder-volume[84012]: DEBUG cinder.db.sqlalchemy.api [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Building query based on filter {{(pid=84012) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 22 23:04:17 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84012) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 22 23:04:17 devstack cinder-volume[84012]: INFO cinder.keymgr.migration [None req-3780c433-4a31-46af-b8d4-12e3adac36e4 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 22 23:04:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:04:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:04:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:04:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:04:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:04:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:04:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.091s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:04:17 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:04:17 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Driver initialization completed successfully.
Sep 22 23:04:17 devstack cinder-volume[84012]: INFO cinder.manager [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Initiating service 3 cleanup
Sep 22 23:04:18 devstack cinder-volume[84012]: INFO cinder.manager [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Service 3 cleanup completed.
Sep 22 23:04:18 devstack cinder-volume[84012]: DEBUG cinder.service [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Creating RPC server for service cinder-volume {{(pid=84012) start /opt/stack/cinder/cinder/service.py:239}}
Sep 22 23:04:18 devstack cinder-volume[84012]: DEBUG cinder.service [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84012) start /opt/stack/cinder/cinder/service.py:245}}
Sep 22 23:04:18 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 22 23:04:18 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:04:18 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:04:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:04:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:04:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:04:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:04:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:04:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:04:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.106s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:04:18 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-33dc1688-c6f6-40d5-ad93-f7f92262b913 None None] Driver post RPC initialization completed successfully.
Sep 22 23:04:19 devstack quobyte-client[84065]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 22 23:04:22 devstack cinder-volume[83741]: DEBUG dbcounter [-] [83741] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83741) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:04:27 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:04:28 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:05:19 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:05:19 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:05:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Flow 'volume_create_manager' (cc4bf987-f11b-428c-b18a-fdf30c147b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:05:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af64fea8-e874-414b-9b48-95ef96a6bfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:05:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af64fea8-e874-414b-9b48-95ef96a6bfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-362240288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03398e40-b799-4195-a02e-be475b2312fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15231368d4804e6eb891bf2c7fe92faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:05:20Z,use_quota=True,user_id='5d54f6f5887f4582b3ba2a51879ca1f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:05:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9df370c-73af-49da-9ea4-9a5ddf397698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:05:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9df370c-73af-49da-9ea4-9a5ddf397698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:05:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115ff4d8-65fd-4944-b086-d551dd2c20e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:05:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115ff4d8-65fd-4944-b086-d551dd2c20e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03398e40-b799-4195-a02e-be475b2312fc', 'volume_name': 'volume-03398e40-b799-4195-a02e-be475b2312fc', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:05:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caad697a-8539-459c-ac5b-afc34f32faaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:05:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caad697a-8539-459c-ac5b-afc34f32faaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:05:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74e0e9d8-da1a-44ab-9b1b-33bb15811b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:05:20 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Volume 03398e40-b799-4195-a02e-be475b2312fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03398e40-b799-4195-a02e-be475b2312fc', 'volume_size': 1}
Sep 22 23:05:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:05:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:05:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-362240288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03398e40-b799-4195-a02e-be475b2312fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15231368d4804e6eb891bf2c7fe92faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:05:20Z,use_quota=True,user_id='5d54f6f5887f4582b3ba2a51879ca1f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:05:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Creating volume 03398e40-b799-4195-a02e-be475b2312fc {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:05:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:05:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:05:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:05:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:05:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:05:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:05:20 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:05:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-03398e40-b799-4195-a02e-be475b2312fc 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:05:20 devstack quobyte-client[84065]: System call of process 84265 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:05:21 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=2, name=volume-03398e40-b799-4195-a02e-be475b2312fc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:05:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-03398e40-b799-4195-a02e-be475b2312fc 1073741824" returned: 0 in 1.164s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:05:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-03398e40-b799-4195-a02e-be475b2312fc {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:05:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-03398e40-b799-4195-a02e-be475b2312fc" returned: 0 in 0.113s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:05:22 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] <== create_volume: return (1360ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:05:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:05:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74e0e9d8-da1a-44ab-9b1b-33bb15811b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03398e40-b799-4195-a02e-be475b2312fc', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:05:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ca1d15-8946-47ef-a452-6e145e18193d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:05:22 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Volume volume-03398e40-b799-4195-a02e-be475b2312fc (03398e40-b799-4195-a02e-be475b2312fc): created successfully
Sep 22 23:05:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ca1d15-8946-47ef-a452-6e145e18193d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:05:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Flow 'volume_create_manager' (cc4bf987-f11b-428c-b18a-fdf30c147b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:05:22 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-7caa97fc-c060-423f-a239-e9a50e7efa0d tempest-TaggedAttachmentsTest-184809797 None] Created volume successfully.
Sep 22 23:05:32 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:05:32 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:05:34 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:05:34 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:05:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Flow 'volume_create_manager' (8149b62d-0226-48db-9f19-93359003e7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:05:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40aa1d77-cb10-40ea-825b-5f3ff21babdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40aa1d77-cb10-40ea-825b-5f3ff21babdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-341373530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477e69e4-edc6-4a68-8677-a0deb4f418ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffc28529647e420c82feb0d211db5a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:05:35Z,use_quota=True,user_id='9d7fc2eb0c9e48ffb43929c5d7ee77c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f3c0ac-2e6e-485e-bdf2-9201fe994b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f3c0ac-2e6e-485e-bdf2-9201fe994b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74efcc50-59ae-4121-9484-227b33f285b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74efcc50-59ae-4121-9484-227b33f285b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '477e69e4-edc6-4a68-8677-a0deb4f418ab', 'volume_name': 'volume-477e69e4-edc6-4a68-8677-a0deb4f418ab', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aac13a8-d7b9-4966-b888-ef604aaf39bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aac13a8-d7b9-4966-b888-ef604aaf39bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f68e5c-2266-4b70-b2ed-528976cca5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:05:35 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Volume 477e69e4-edc6-4a68-8677-a0deb4f418ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-477e69e4-edc6-4a68-8677-a0deb4f418ab', 'volume_size': 1}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-341373530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477e69e4-edc6-4a68-8677-a0deb4f418ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffc28529647e420c82feb0d211db5a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:05:35Z,use_quota=True,user_id='9d7fc2eb0c9e48ffb43929c5d7ee77c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Creating volume 477e69e4-edc6-4a68-8677-a0deb4f418ab {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:05:35 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-477e69e4-edc6-4a68-8677-a0deb4f418ab 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:05:35 devstack quobyte-client[84065]: System call of process 84601 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:05:35 devstack quobyte-client[84065]: System call of process 84601 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:05:35 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=3, name=volume-477e69e4-edc6-4a68-8677-a0deb4f418ab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-477e69e4-edc6-4a68-8677-a0deb4f418ab 1073741824" returned: 0 in 0.506s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-477e69e4-edc6-4a68-8677-a0deb4f418ab {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-477e69e4-edc6-4a68-8677-a0deb4f418ab" returned: 0 in 0.127s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] <== create_volume: return (717ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:05:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:05:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f68e5c-2266-4b70-b2ed-528976cca5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-477e69e4-edc6-4a68-8677-a0deb4f418ab', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:05:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e156b57-0e6c-4389-843e-850628d4cfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:05:36 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Volume volume-477e69e4-edc6-4a68-8677-a0deb4f418ab (477e69e4-edc6-4a68-8677-a0deb4f418ab): created successfully
Sep 22 23:05:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e156b57-0e6c-4389-843e-850628d4cfbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:05:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Flow 'volume_create_manager' (8149b62d-0226-48db-9f19-93359003e7ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:05:36 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-84d8ec30-ea0c-4e6c-86fe-f27b59aeb0cb tempest-VolumesAssistedSnapshotsTest-1438778723 None] Created volume successfully.
Sep 22 23:05:46 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:05:46 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:05:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:05:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:05:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:05:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:05:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:05:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:05:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:05:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.152s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:05:47 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:06:28 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:06:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:06:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:06:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:06:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:06:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:06:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:06:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:06:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.220s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:06:47 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:07:47 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:07:47 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:07:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Flow 'volume_create_manager' (813ba8fa-72b5-4d23-859d-eb577472d7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:07:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b10d401-5039-4804-819b-fb99b8295619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:07:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:07:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:07:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:07:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:07:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:07:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:07:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:07:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b10d401-5039-4804-819b-fb99b8295619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-196813310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3fda43e-c416-40fb-bb76-4109dc64eb2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c81bdd93584fa6a16e6a13bce518b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:07:47Z,use_quota=True,user_id='84e188a9873c4287abec870e93d3353d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:07:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3446bc-a839-4efc-b91f-bf55e2026738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:07:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3446bc-a839-4efc-b91f-bf55e2026738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:07:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e29dce3-e11e-4cc9-bc95-96370d69f7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:07:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e29dce3-e11e-4cc9-bc95-96370d69f7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3fda43e-c416-40fb-bb76-4109dc64eb2e', 'volume_name': 'volume-c3fda43e-c416-40fb-bb76-4109dc64eb2e', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:07:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0702add-ddc9-44e1-bf80-a6c60a0a93ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:07:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0702add-ddc9-44e1-bf80-a6c60a0a93ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:07:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c006d58-8f2a-46b6-a339-1bfdbe8db3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:07:48 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Volume c3fda43e-c416-40fb-bb76-4109dc64eb2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3fda43e-c416-40fb-bb76-4109dc64eb2e', 'volume_size': 1}
Sep 22 23:07:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:07:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:07:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-196813310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3fda43e-c416-40fb-bb76-4109dc64eb2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c81bdd93584fa6a16e6a13bce518b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:07:47Z,use_quota=True,user_id='84e188a9873c4287abec870e93d3353d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:07:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Creating volume c3fda43e-c416-40fb-bb76-4109dc64eb2e {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:07:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:07:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:07:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:07:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:07:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:07:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:07:48 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:07:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c3fda43e-c416-40fb-bb76-4109dc64eb2e 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:07:49 devstack quobyte-client[84065]: System call of process 85303 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:07:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 1.387s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:07:49 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=4, name=volume-c3fda43e-c416-40fb-bb76-4109dc64eb2e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:07:49 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:07:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c3fda43e-c416-40fb-bb76-4109dc64eb2e 1073741824" returned: 0 in 0.849s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:07:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c3fda43e-c416-40fb-bb76-4109dc64eb2e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:07:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c3fda43e-c416-40fb-bb76-4109dc64eb2e" returned: 0 in 0.225s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:07:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] <== create_volume: return (1176ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:07:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:07:50 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c006d58-8f2a-46b6-a339-1bfdbe8db3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3fda43e-c416-40fb-bb76-4109dc64eb2e', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:07:50 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343685f2-b9dc-4e68-82ce-531b60047531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:07:50 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Volume volume-c3fda43e-c416-40fb-bb76-4109dc64eb2e (c3fda43e-c416-40fb-bb76-4109dc64eb2e): created successfully
Sep 22 23:07:50 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343685f2-b9dc-4e68-82ce-531b60047531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:07:50 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Flow 'volume_create_manager' (813ba8fa-72b5-4d23-859d-eb577472d7d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:07:50 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-5cd4f8cf-1161-42a2-967c-3565187d441d tempest-AttachSCSIVolumeTestJSON-175131064 None] Created volume successfully.
Sep 22 23:08:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-00250825-c174-41da-86df-0b1ccc276f03 req-7783f649-1b7f-4650-8543-eb77077f8f11 tempest-AttachSCSIVolumeTestJSON-175131064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:08:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-00250825-c174-41da-86df-0b1ccc276f03 req-7783f649-1b7f-4650-8543-eb77077f8f11 tempest-AttachSCSIVolumeTestJSON-175131064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:08:00 devstack cinder-volume[84012]: INFO oslo.privsep.daemon [req-00250825-c174-41da-86df-0b1ccc276f03 req-7783f649-1b7f-4650-8543-eb77077f8f11 tempest-AttachSCSIVolumeTestJSON-175131064 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpymudg1_b/privsep.sock']
Sep 22 23:08:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-16fd1d4e-7da7-451d-b812-1f33803fb376 req-bdb7d9ba-b938-4acc-b021-c6aa41ae5669 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:08:00 devstack sudo[85414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpymudg1_b/privsep.sock
Sep 22 23:08:00 devstack sudo[85414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:08:04 devstack sudo[85414]: pam_unix(sudo:session): session closed for user root
Sep 22 23:08:04 devstack cinder-volume[84012]: INFO oslo.privsep.daemon [req-00250825-c174-41da-86df-0b1ccc276f03 req-7783f649-1b7f-4650-8543-eb77077f8f11 tempest-AttachSCSIVolumeTestJSON-175131064 None] Spawned new privsep daemon via rootwrap
Sep 22 23:08:04 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [req-00250825-c174-41da-86df-0b1ccc276f03 req-7783f649-1b7f-4650-8543-eb77077f8f11 tempest-AttachSCSIVolumeTestJSON-175131064 None] Accepted privsep connection to /tmp/tmpymudg1_b/privsep.sock {{(pid=84012) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 22 23:08:04 devstack cinder-volume[84012]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 22 23:08:04 devstack cinder-volume[84012]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 22 23:08:04 devstack cinder-volume[84012]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 22 23:08:04 devstack cinder-volume[84012]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85425
Sep 22 23:08:04 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[69003da6-18f7-403b-b442-89274c25cece]: (2,) {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:08:04 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e5e85a-116d-4bc8-9d00-557ebc7ac192]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:08:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-00250825-c174-41da-86df-0b1ccc276f03 req-7783f649-1b7f-4650-8543-eb77077f8f11 tempest-AttachSCSIVolumeTestJSON-175131064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c3fda43e-c416-40fb-bb76-4109dc64eb2e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:08:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-00250825-c174-41da-86df-0b1ccc276f03 req-7783f649-1b7f-4650-8543-eb77077f8f11 tempest-AttachSCSIVolumeTestJSON-175131064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c3fda43e-c416-40fb-bb76-4109dc64eb2e" returned: 0 in 0.371s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:08:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-00250825-c174-41da-86df-0b1ccc276f03 req-7783f649-1b7f-4650-8543-eb77077f8f11 tempest-AttachSCSIVolumeTestJSON-175131064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 5.095s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:08:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-16fd1d4e-7da7-451d-b812-1f33803fb376 req-bdb7d9ba-b938-4acc-b021-c6aa41ae5669 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.259s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:08:05 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[50863647-b73d-43ae-95a9-3ee522131e0b]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:08:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-16fd1d4e-7da7-451d-b812-1f33803fb376 req-bdb7d9ba-b938-4acc-b021-c6aa41ae5669 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-477e69e4-edc6-4a68-8677-a0deb4f418ab {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:08:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-00250825-c174-41da-86df-0b1ccc276f03 req-7783f649-1b7f-4650-8543-eb77077f8f11 tempest-AttachSCSIVolumeTestJSON-175131064 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-c3fda43e-c416-40fb-bb76-4109dc64eb2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '747f61b5-af5b-4c7b-b63b-525c10aa0ffd', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:08:06 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-00250825-c174-41da-86df-0b1ccc276f03 req-7783f649-1b7f-4650-8543-eb77077f8f11 tempest-AttachSCSIVolumeTestJSON-175131064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:08:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-16fd1d4e-7da7-451d-b812-1f33803fb376 req-bdb7d9ba-b938-4acc-b021-c6aa41ae5669 tempest-VolumesAssistedSnapshotsTest-1438778723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-477e69e4-edc6-4a68-8677-a0deb4f418ab" returned: 0 in 0.599s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:08:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-16fd1d4e-7da7-451d-b812-1f33803fb376 req-bdb7d9ba-b938-4acc-b021-c6aa41ae5669 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.663s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:08:06 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-00250825-c174-41da-86df-0b1ccc276f03 req-7783f649-1b7f-4650-8543-eb77077f8f11 tempest-AttachSCSIVolumeTestJSON-175131064 None] attachment_update completed successfully.
Sep 22 23:08:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-16fd1d4e-7da7-451d-b812-1f33803fb376 req-bdb7d9ba-b938-4acc-b021-c6aa41ae5669 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-477e69e4-edc6-4a68-8677-a0deb4f418ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb8838e3-5ac9-4ff2-809e-e778f5b55aee', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:08:06 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-16fd1d4e-7da7-451d-b812-1f33803fb376 req-bdb7d9ba-b938-4acc-b021-c6aa41ae5669 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:08:06 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-16fd1d4e-7da7-451d-b812-1f33803fb376 req-bdb7d9ba-b938-4acc-b021-c6aa41ae5669 tempest-VolumesAssistedSnapshotsTest-1438778723 None] attachment_update completed successfully.
Sep 22 23:08:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-4850e217-e916-41f8-b507-bc6fb29daedb req-d72abaa4-a44a-4936-88de-e976d8823789 tempest-TaggedAttachmentsTest-184809797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:08:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-4850e217-e916-41f8-b507-bc6fb29daedb req-d72abaa4-a44a-4936-88de-e976d8823789 tempest-TaggedAttachmentsTest-184809797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:08:12 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7fc5c2-ea00-4693-92e4-c0b59aed2347]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:08:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-4850e217-e916-41f8-b507-bc6fb29daedb req-d72abaa4-a44a-4936-88de-e976d8823789 tempest-TaggedAttachmentsTest-184809797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-03398e40-b799-4195-a02e-be475b2312fc {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:08:12 devstack quobyte-client[84065]: System call of process 85872 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:08:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-4850e217-e916-41f8-b507-bc6fb29daedb req-d72abaa4-a44a-4936-88de-e976d8823789 tempest-TaggedAttachmentsTest-184809797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-03398e40-b799-4195-a02e-be475b2312fc" returned: 0 in 0.523s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:08:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-4850e217-e916-41f8-b507-bc6fb29daedb req-d72abaa4-a44a-4936-88de-e976d8823789 tempest-TaggedAttachmentsTest-184809797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.580s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:08:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-4850e217-e916-41f8-b507-bc6fb29daedb req-d72abaa4-a44a-4936-88de-e976d8823789 tempest-TaggedAttachmentsTest-184809797 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-03398e40-b799-4195-a02e-be475b2312fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e5b98b4-4b74-4b27-8082-26bd648e99d0', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:08:12 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-4850e217-e916-41f8-b507-bc6fb29daedb req-d72abaa4-a44a-4936-88de-e976d8823789 tempest-TaggedAttachmentsTest-184809797 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:08:13 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-4850e217-e916-41f8-b507-bc6fb29daedb req-d72abaa4-a44a-4936-88de-e976d8823789 tempest-TaggedAttachmentsTest-184809797 None] attachment_update completed successfully.
Sep 22 23:08:23 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=7,cinder:SELECT=15 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:08:28 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=21,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:08:38 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-1733c8bb-956f-442c-b105-ffd42793de79 req-1cc9f799-e612-42d9-ba7b-ddf3f6dabf8b tempest-VolumesAssistedSnapshotsTest-1438778723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:08:38 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-1733c8bb-956f-442c-b105-ffd42793de79 req-1cc9f799-e612-42d9-ba7b-ddf3f6dabf8b tempest-VolumesAssistedSnapshotsTest-1438778723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:08:38 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-1733c8bb-956f-442c-b105-ffd42793de79 req-1cc9f799-e612-42d9-ba7b-ddf3f6dabf8b tempest-VolumesAssistedSnapshotsTest-1438778723 None] Terminate volume connection completed successfully.
Sep 22 23:08:38 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-1733c8bb-956f-442c-b105-ffd42793de79 req-1cc9f799-e612-42d9-ba7b-ddf3f6dabf8b tempest-VolumesAssistedSnapshotsTest-1438778723 None] Deleting attachment fb8838e3-5ac9-4ff2-809e-e778f5b55aee. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:08:38 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-9f21f370-5cba-4312-a5b8-a87a7c0f8bc3 req-5e935419-aebe-4234-b439-7539876ccc31 tempest-AttachSCSIVolumeTestJSON-175131064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:08:38 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-9f21f370-5cba-4312-a5b8-a87a7c0f8bc3 req-5e935419-aebe-4234-b439-7539876ccc31 tempest-AttachSCSIVolumeTestJSON-175131064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:08:38 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-9f21f370-5cba-4312-a5b8-a87a7c0f8bc3 req-5e935419-aebe-4234-b439-7539876ccc31 tempest-AttachSCSIVolumeTestJSON-175131064 None] Terminate volume connection completed successfully.
Sep 22 23:08:38 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-9f21f370-5cba-4312-a5b8-a87a7c0f8bc3 req-5e935419-aebe-4234-b439-7539876ccc31 tempest-AttachSCSIVolumeTestJSON-175131064 None] Deleting attachment 747f61b5-af5b-4c7b-b63b-525c10aa0ffd. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:08:40 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Acquiring lock "cinder-477e69e4-edc6-4a68-8677-a0deb4f418ab-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:08:40 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Lock "cinder-477e69e4-edc6-4a68-8677-a0deb4f418ab-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:08:40 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:08:40 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Acquiring lock "cinder-quobyte-477e69e4-edc6-4a68-8677-a0deb4f418ab" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:08:40 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Lock "cinder-quobyte-477e69e4-edc6-4a68-8677-a0deb4f418ab" acquired by "delete_volume" :: waited 0.023s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:08:40 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c8e3ee-0a92-4dda-bf58-be7227879969]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:08:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-477e69e4-edc6-4a68-8677-a0deb4f418ab {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:08:40 devstack quobyte-client[84065]: System call of process 85938 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:08:40 devstack quobyte-client[84065]: System call of process 85938 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:08:40 devstack quobyte-client[84065]: System call of process 85938 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:08:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-477e69e4-edc6-4a68-8677-a0deb4f418ab" returned: 0 in 0.534s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:08:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-477e69e4-edc6-4a68-8677-a0deb4f418ab {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:08:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-477e69e4-edc6-4a68-8677-a0deb4f418ab" returned: 0 in 0.099s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:08:41 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Lock "cinder-quobyte-477e69e4-edc6-4a68-8677-a0deb4f418ab" released by "delete_volume" :: held 0.809s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:08:41 devstack cinder-volume[84012]: WARNING cinder.quota [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:08:41 devstack cinder-volume[84012]: WARNING cinder.quota [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:08:41 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Created reservations ['a03c5a3c-30ba-4002-bbdd-f9f23dfd38d2', '8e6b4510-0175-49c3-83c7-3d9b1719b4d9', 'e9742644-0c2e-422a-a616-79dd9f02960e', 'd9904a0c-4ec7-4e04-9bc1-3ae2fa573d9a'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:08:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:08:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:08:41 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:08:41 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:08:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:08:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:08:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.079s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:08:41 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:08:41 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Deleted volume successfully.
Sep 22 23:08:42 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c3ffea1b-09c4-4a9d-8753-20332095e0b9 tempest-VolumesAssistedSnapshotsTest-1438778723 None] Lock "cinder-477e69e4-edc6-4a68-8677-a0deb4f418ab-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:08:43 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-01f9ee60-b484-47d4-b56d-6b3b8a7ba51e req-e4d3526d-7c6e-4556-9b83-7d4ffb658aef tempest-TaggedAttachmentsTest-184809797 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:08:43 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-01f9ee60-b484-47d4-b56d-6b3b8a7ba51e req-e4d3526d-7c6e-4556-9b83-7d4ffb658aef tempest-TaggedAttachmentsTest-184809797 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:08:43 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-01f9ee60-b484-47d4-b56d-6b3b8a7ba51e req-e4d3526d-7c6e-4556-9b83-7d4ffb658aef tempest-TaggedAttachmentsTest-184809797 None] Terminate volume connection completed successfully.
Sep 22 23:08:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-01f9ee60-b484-47d4-b56d-6b3b8a7ba51e req-e4d3526d-7c6e-4556-9b83-7d4ffb658aef tempest-TaggedAttachmentsTest-184809797 None] Deleting attachment 3e5b98b4-4b74-4b27-8082-26bd648e99d0. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:08:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:08:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:08:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:08:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:08:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:08:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.085s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:08:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:08:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.295s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:08:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:08:52 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:08:53 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=10 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:08:55 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-94e4e559-7fad-457b-9861-aea9b78d2cd6 tempest-AttachSCSIVolumeTestJSON-175131064 None] Acquiring lock "cinder-c3fda43e-c416-40fb-bb76-4109dc64eb2e-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:08:55 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-94e4e559-7fad-457b-9861-aea9b78d2cd6 tempest-AttachSCSIVolumeTestJSON-175131064 None] Lock "cinder-c3fda43e-c416-40fb-bb76-4109dc64eb2e-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:08:55 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-94e4e559-7fad-457b-9861-aea9b78d2cd6 tempest-AttachSCSIVolumeTestJSON-175131064 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:08:55 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-94e4e559-7fad-457b-9861-aea9b78d2cd6 tempest-AttachSCSIVolumeTestJSON-175131064 None] Acquiring lock "cinder-quobyte-c3fda43e-c416-40fb-bb76-4109dc64eb2e" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:08:55 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-94e4e559-7fad-457b-9861-aea9b78d2cd6 tempest-AttachSCSIVolumeTestJSON-175131064 None] Lock "cinder-quobyte-c3fda43e-c416-40fb-bb76-4109dc64eb2e" acquired by "delete_volume" :: waited 0.037s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:08:55 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fa12ae-718f-4904-a256-f6054e115af4]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:08:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-94e4e559-7fad-457b-9861-aea9b78d2cd6 tempest-AttachSCSIVolumeTestJSON-175131064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c3fda43e-c416-40fb-bb76-4109dc64eb2e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:08:56 devstack quobyte-client[84065]: System call of process 86080 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:08:56 devstack quobyte-client[84065]: System call of process 86080 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:08:56 devstack quobyte-client[84065]: System call of process 86080 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:08:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-94e4e559-7fad-457b-9861-aea9b78d2cd6 tempest-AttachSCSIVolumeTestJSON-175131064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c3fda43e-c416-40fb-bb76-4109dc64eb2e" returned: 0 in 0.610s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:08:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-94e4e559-7fad-457b-9861-aea9b78d2cd6 tempest-AttachSCSIVolumeTestJSON-175131064 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c3fda43e-c416-40fb-bb76-4109dc64eb2e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:08:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-94e4e559-7fad-457b-9861-aea9b78d2cd6 tempest-AttachSCSIVolumeTestJSON-175131064 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c3fda43e-c416-40fb-bb76-4109dc64eb2e" returned: 0 in 0.113s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:08:56 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-94e4e559-7fad-457b-9861-aea9b78d2cd6 tempest-AttachSCSIVolumeTestJSON-175131064 None] Lock "cinder-quobyte-c3fda43e-c416-40fb-bb76-4109dc64eb2e" released by "delete_volume" :: held 0.992s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:08:57 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-94e4e559-7fad-457b-9861-aea9b78d2cd6 tempest-AttachSCSIVolumeTestJSON-175131064 None] Created reservations ['7de88c55-0e30-45cd-8f36-3de9613e5202', '40c3b3a4-1276-4e8b-b5c6-4bbc2a22d724', '655d5083-45ba-4efb-abee-dd311df93b0f', 'db0b3702-7fab-4056-b632-c90424785363'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:08:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-94e4e559-7fad-457b-9861-aea9b78d2cd6 tempest-AttachSCSIVolumeTestJSON-175131064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:08:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-94e4e559-7fad-457b-9861-aea9b78d2cd6 tempest-AttachSCSIVolumeTestJSON-175131064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:08:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-94e4e559-7fad-457b-9861-aea9b78d2cd6 tempest-AttachSCSIVolumeTestJSON-175131064 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:08:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-94e4e559-7fad-457b-9861-aea9b78d2cd6 tempest-AttachSCSIVolumeTestJSON-175131064 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:08:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-94e4e559-7fad-457b-9861-aea9b78d2cd6 tempest-AttachSCSIVolumeTestJSON-175131064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:08:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-94e4e559-7fad-457b-9861-aea9b78d2cd6 tempest-AttachSCSIVolumeTestJSON-175131064 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:08:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-94e4e559-7fad-457b-9861-aea9b78d2cd6 tempest-AttachSCSIVolumeTestJSON-175131064 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.083s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:08:57 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-94e4e559-7fad-457b-9861-aea9b78d2cd6 tempest-AttachSCSIVolumeTestJSON-175131064 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:08:57 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-94e4e559-7fad-457b-9861-aea9b78d2cd6 tempest-AttachSCSIVolumeTestJSON-175131064 None] Deleted volume successfully.
Sep 22 23:08:57 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-94e4e559-7fad-457b-9861-aea9b78d2cd6 tempest-AttachSCSIVolumeTestJSON-175131064 None] Lock "cinder-c3fda43e-c416-40fb-bb76-4109dc64eb2e-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:09:07 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=3,cinder:INSERT=3,cinder:UPDATE=13 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:09:07 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:09:36 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0cab18d5-7377-4af5-8b8f-7229a73734c3 tempest-TaggedAttachmentsTest-184809797 None] Acquiring lock "cinder-03398e40-b799-4195-a02e-be475b2312fc-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:09:36 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0cab18d5-7377-4af5-8b8f-7229a73734c3 tempest-TaggedAttachmentsTest-184809797 None] Lock "cinder-03398e40-b799-4195-a02e-be475b2312fc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:09:37 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-0cab18d5-7377-4af5-8b8f-7229a73734c3 tempest-TaggedAttachmentsTest-184809797 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:09:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0cab18d5-7377-4af5-8b8f-7229a73734c3 tempest-TaggedAttachmentsTest-184809797 None] Acquiring lock "cinder-quobyte-03398e40-b799-4195-a02e-be475b2312fc" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:09:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0cab18d5-7377-4af5-8b8f-7229a73734c3 tempest-TaggedAttachmentsTest-184809797 None] Lock "cinder-quobyte-03398e40-b799-4195-a02e-be475b2312fc" acquired by "delete_volume" :: waited 0.020s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:09:37 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44625a7-41d7-4f08-bffc-b07134098c58]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:09:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0cab18d5-7377-4af5-8b8f-7229a73734c3 tempest-TaggedAttachmentsTest-184809797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-03398e40-b799-4195-a02e-be475b2312fc {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:09:38 devstack quobyte-client[84065]: System call of process 86160 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:09:38 devstack quobyte-client[84065]: System call of process 86160 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:09:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0cab18d5-7377-4af5-8b8f-7229a73734c3 tempest-TaggedAttachmentsTest-184809797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-03398e40-b799-4195-a02e-be475b2312fc" returned: 0 in 0.754s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:09:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0cab18d5-7377-4af5-8b8f-7229a73734c3 tempest-TaggedAttachmentsTest-184809797 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-03398e40-b799-4195-a02e-be475b2312fc {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:09:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0cab18d5-7377-4af5-8b8f-7229a73734c3 tempest-TaggedAttachmentsTest-184809797 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-03398e40-b799-4195-a02e-be475b2312fc" returned: 0 in 0.126s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:09:38 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0cab18d5-7377-4af5-8b8f-7229a73734c3 tempest-TaggedAttachmentsTest-184809797 None] Lock "cinder-quobyte-03398e40-b799-4195-a02e-be475b2312fc" released by "delete_volume" :: held 1.134s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:09:38 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-0cab18d5-7377-4af5-8b8f-7229a73734c3 tempest-TaggedAttachmentsTest-184809797 None] Created reservations ['6b8e463e-492f-4729-a0b5-a29ab73992a3', 'c1a5ba64-8e04-4538-9bb2-f4f8cad4e4db', 'c46d785a-5605-4b34-a01d-a3d9be2f6288', 'b7280862-e5cc-4fa5-93d8-cd03c0259524'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:09:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0cab18d5-7377-4af5-8b8f-7229a73734c3 tempest-TaggedAttachmentsTest-184809797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:09:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0cab18d5-7377-4af5-8b8f-7229a73734c3 tempest-TaggedAttachmentsTest-184809797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:09:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0cab18d5-7377-4af5-8b8f-7229a73734c3 tempest-TaggedAttachmentsTest-184809797 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:09:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0cab18d5-7377-4af5-8b8f-7229a73734c3 tempest-TaggedAttachmentsTest-184809797 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:09:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0cab18d5-7377-4af5-8b8f-7229a73734c3 tempest-TaggedAttachmentsTest-184809797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:09:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0cab18d5-7377-4af5-8b8f-7229a73734c3 tempest-TaggedAttachmentsTest-184809797 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:09:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0cab18d5-7377-4af5-8b8f-7229a73734c3 tempest-TaggedAttachmentsTest-184809797 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.183s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:09:39 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-0cab18d5-7377-4af5-8b8f-7229a73734c3 tempest-TaggedAttachmentsTest-184809797 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:09:39 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-0cab18d5-7377-4af5-8b8f-7229a73734c3 tempest-TaggedAttachmentsTest-184809797 None] Deleted volume successfully.
Sep 22 23:09:39 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0cab18d5-7377-4af5-8b8f-7229a73734c3 tempest-TaggedAttachmentsTest-184809797 None] Lock "cinder-03398e40-b799-4195-a02e-be475b2312fc-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:09:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:09:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:09:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:09:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:09:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:09:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:09:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:09:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.124s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:09:47 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:09:49 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=11 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:09:49 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=5,cinder:SELECT=6,cinder:INSERT=3,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:10:14 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:10:14 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:10:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Flow 'volume_create_manager' (5f468c97-2f66-4caa-95ba-8b88ec032593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:10:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb5d624-35a8-4b0e-9171-59b2ad0fcc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb5d624-35a8-4b0e-9171-59b2ad0fcc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1774922217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599eb48a-3c51-4f60-a512-a0e5f85ccda4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6547b825dcc64b6cad9825ae7680a12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:10:15Z,use_quota=True,user_id='7df3bb3e97a746fbb8f425d9e39e806c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03715ef-a055-46f9-915f-988e18aa0675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03715ef-a055-46f9-915f-988e18aa0675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb9a559-a549-4eb8-b0d2-6b95091434df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:15 devstack cinder-volume[84012]: DEBUG cinder.image.glance [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Creating Keystone auth plugin from conf {{(pid=84012) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 22 23:10:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb9a559-a549-4eb8-b0d2-6b95091434df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '599eb48a-3c51-4f60-a512-a0e5f85ccda4', 'volume_name': 'volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4', 'volume_size': 1, 'image_id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b1f99fd8595b4e59a87b2ac5fd8513ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'created_at': datetime.datetime(2025, 9, 22, 20, 57, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 20, 57, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0d0f829cf0>}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2ac6ed-64d3-41ee-b911-3391308629a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2ac6ed-64d3-41ee-b911-3391308629a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ade357-0b7d-442e-8706-d194e9ba6c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:16 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Volume 599eb48a-3c51-4f60-a512-a0e5f85ccda4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4', 'volume_size': 1, 'image_id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b1f99fd8595b4e59a87b2ac5fd8513ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'created_at': datetime.datetime(2025, 9, 22, 20, 57, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 20, 57, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0d0f829cf0>}
Sep 22 23:10:16 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Cloning 599eb48a-3c51-4f60-a512-a0e5f85ccda4 from image 60f4d0ec-ef65-4fa8-9530-b89728f917ec  at location (None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}]). {{(pid=84012) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 22 23:10:17 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_kyx96iyrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84012) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 22 23:10:17 devstack cinder-volume[84012]: INFO cinder.image.image_utils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Image download 20.69 MB at 20.69 MB/s
Sep 22 23:10:17 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e0abc2-e1bf-4c72-a41f-5af30de29fc7]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:10:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_kyx96iyrdevstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:10:18 devstack sudo[86236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_kyx96iyrdevstack@QuobyteHD
Sep 22 23:10:18 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:10:20 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root
Sep 22 23:10:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_kyx96iyrdevstack@QuobyteHD" returned: 0 in 3.017s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:10:20 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Temporary image 60f4d0ec-ef65-4fa8-9530-b89728f917ec is fetched for user 7df3bb3e97a746fbb8f425d9e39e806c. {{(pid=84012) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 22 23:10:20 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[764c4555-c1b1-43af-bfce-7ba056e1cf95]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:10:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_kyx96iyrdevstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:10:21 devstack sudo[86241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_kyx96iyrdevstack@QuobyteHD
Sep 22 23:10:21 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:10:23 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root
Sep 22 23:10:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_kyx96iyrdevstack@QuobyteHD" returned: 0 in 2.632s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:10:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:10:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.025s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:10:23 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1774922217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599eb48a-3c51-4f60-a512-a0e5f85ccda4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6547b825dcc64b6cad9825ae7680a12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:10:15Z,use_quota=True,user_id='7df3bb3e97a746fbb8f425d9e39e806c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:10:23 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Creating volume 599eb48a-3c51-4f60-a512-a0e5f85ccda4 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:10:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:10:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:10:23 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:10:23 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:10:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.088s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:10:23 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:10:23 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:10:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:10:23 devstack quobyte-client[84065]: System call of process 86249 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:10:23 devstack quobyte-client[84065]: System call of process 86249 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:10:23 devstack quobyte-client[84065]: System call of process 86249 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:10:23 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=5, name=volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:10:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4 1073741824" returned: 0 in 0.551s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:10:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:10:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4" returned: 0 in 0.127s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:10:24 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] <== create_volume: return (849ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:10:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:10:24 devstack cinder-volume[84012]: DEBUG cinder.volume.volume_utils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Attempting download of 60f4d0ec-ef65-4fa8-9530-b89728f917ec ((None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}])) to volume 599eb48a-3c51-4f60-a512-a0e5f85ccda4. {{(pid=84012) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 22 23:10:24 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23ec4f8-2f39-4299-a215-536bca0a0790]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:10:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60f4d0ec-ef65-4fa8-9530-b89728f917ec_tba9_pz0 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:10:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60f4d0ec-ef65-4fa8-9530-b89728f917ec_tba9_pz0" returned: 0 in 0.556s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:10:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60f4d0ec-ef65-4fa8-9530-b89728f917ec_tba9_pz0 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:10:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60f4d0ec-ef65-4fa8-9530-b89728f917ec_tba9_pz0" returned: 1 in 0.679s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:10:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60f4d0ec-ef65-4fa8-9530-b89728f917ec_tba9_pz0' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:10:26 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4f9167-07f1-4e89-bfed-c9c3bab1b635]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:10:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_kyx96iyrdevstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:10:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_kyx96iyrdevstack@QuobyteHD" returned: 0 in 0.632s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:10:26 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] 60f4d0ec-ef65-4fa8-9530-b89728f917ec was qcow2, converting to raw {{(pid=84012) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 22 23:10:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_kyx96iyrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:10:27 devstack quobyte-client[84065]: System call of process 86260 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:10:27 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=5, name=volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:10:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_kyx96iyrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4" returned: 0 in 1.699s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:10:28 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_kyx96iyrdevstack@QuobyteHD, size 112.00 MB, duration 1.75 sec, destination /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4 {{(pid=84012) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 22 23:10:28 devstack cinder-volume[84012]: INFO cinder.image.image_utils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Converted 112.00 MB image at 64.15 MB/s
Sep 22 23:10:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:10:28 devstack quobyte-client[84065]: System call of process 86279 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:10:28 devstack quobyte-client[84065]: System call of process 86279 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:10:28 devstack quobyte-client[84065]: System call of process 86279 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:10:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4 1G" returned: 0 in 0.278s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:10:29 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5430a413-e392-46bb-9303-d1433e4a71ad]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:10:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:10:29 devstack quobyte-client[84065]: System call of process 86282 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:10:29 devstack quobyte-client[84065]: System call of process 86282 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:10:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4" returned: 0 in 0.659s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:10:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:10:30 devstack quobyte-client[84065]: System call of process 86284 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:10:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4" returned: 1 in 0.823s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:10:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:10:30 devstack cinder-volume[84012]: DEBUG cinder.volume.volume_utils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Downloaded image 60f4d0ec-ef65-4fa8-9530-b89728f917ec ((None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}])) to volume 599eb48a-3c51-4f60-a512-a0e5f85ccda4 successfully. {{(pid=84012) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 22 23:10:30 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Temporary image 60f4d0ec-ef65-4fa8-9530-b89728f917ec for user 7df3bb3e97a746fbb8f425d9e39e806c is deleted. {{(pid=84012) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 22 23:10:30 devstack cinder-volume[84012]: DEBUG cinder.volume.volume_utils [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Marking volume 599eb48a-3c51-4f60-a512-a0e5f85ccda4 as bootable. {{(pid=84012) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 22 23:10:31 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Copying metadata from image 60f4d0ec-ef65-4fa8-9530-b89728f917ec to 599eb48a-3c51-4f60-a512-a0e5f85ccda4. {{(pid=84012) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 22 23:10:31 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Creating volume glance metadata for volume 599eb48a-3c51-4f60-a512-a0e5f85ccda4 backed by image 60f4d0ec-ef65-4fa8-9530-b89728f917ec with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84012) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 22 23:10:31 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ade357-0b7d-442e-8706-d194e9ba6c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4', 'volume_size': 1, 'image_id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b1f99fd8595b4e59a87b2ac5fd8513ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'created_at': datetime.datetime(2025, 9, 22, 20, 57, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 20, 57, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0d0f829cf0>}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:31 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a380e216-24b4-4b5b-8efa-2381ed05a137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:31 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Volume volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4 (599eb48a-3c51-4f60-a512-a0e5f85ccda4): created successfully
Sep 22 23:10:31 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a380e216-24b4-4b5b-8efa-2381ed05a137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:31 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Flow 'volume_create_manager' (5f468c97-2f66-4caa-95ba-8b88ec032593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:10:31 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-140db62e-fdaf-45a0-b7d2-6d43b4360788 tempest-TaggedBootDevicesTest-816810426 None] Created volume successfully.
Sep 22 23:10:33 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Flow 'volume_create_manager' (daa99f1b-987f-4ada-8c36-b886c26240db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0347045-9f4a-40e4-ac6f-b6be68b8fcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0347045-9f4a-40e4-ac6f-b6be68b8fcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1317868334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f449de4-a764-4fbe-8add-48706f79684c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6547b825dcc64b6cad9825ae7680a12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:10:33Z,use_quota=True,user_id='7df3bb3e97a746fbb8f425d9e39e806c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c86e2a2-55c3-49ee-8fb1-3f5788c53f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c86e2a2-55c3-49ee-8fb1-3f5788c53f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b1e2236-8a51-4d18-ae3c-a987b8e049d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b1e2236-8a51-4d18-ae3c-a987b8e049d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f449de4-a764-4fbe-8add-48706f79684c', 'volume_name': 'volume-8f449de4-a764-4fbe-8add-48706f79684c', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97dd07df-dae9-43f7-af2c-6ffba2c87a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97dd07df-dae9-43f7-af2c-6ffba2c87a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9eed08a-e786-422b-9e40-e4556f1c90bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:33 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Volume 8f449de4-a764-4fbe-8add-48706f79684c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f449de4-a764-4fbe-8add-48706f79684c', 'volume_size': 1}
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1317868334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f449de4-a764-4fbe-8add-48706f79684c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6547b825dcc64b6cad9825ae7680a12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:10:33Z,use_quota=True,user_id='7df3bb3e97a746fbb8f425d9e39e806c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Creating volume 8f449de4-a764-4fbe-8add-48706f79684c {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:10:33 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8f449de4-a764-4fbe-8add-48706f79684c 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:10:33 devstack quobyte-client[84065]: System call of process 86288 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:10:33 devstack quobyte-client[84065]: System call of process 86288 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:10:33 devstack quobyte-client[84065]: System call of process 86288 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:10:33 devstack quobyte-client[84065]: System call of process 86288 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:10:33 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=6, name=volume-8f449de4-a764-4fbe-8add-48706f79684c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8f449de4-a764-4fbe-8add-48706f79684c 1073741824" returned: 0 in 0.508s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:10:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8f449de4-a764-4fbe-8add-48706f79684c {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:10:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8f449de4-a764-4fbe-8add-48706f79684c" returned: 0 in 0.241s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:10:34 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] <== create_volume: return (816ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:10:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:10:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9eed08a-e786-422b-9e40-e4556f1c90bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f449de4-a764-4fbe-8add-48706f79684c', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57fead8-97c7-4607-b113-e52ca035f8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:34 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Volume volume-8f449de4-a764-4fbe-8add-48706f79684c (8f449de4-a764-4fbe-8add-48706f79684c): created successfully
Sep 22 23:10:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57fead8-97c7-4607-b113-e52ca035f8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Flow 'volume_create_manager' (daa99f1b-987f-4ada-8c36-b886c26240db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:10:34 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-741c8e33-9c33-419e-9278-12666c522ef1 tempest-TaggedBootDevicesTest-816810426 None] Created volume successfully.
Sep 22 23:10:36 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Flow 'volume_create_manager' (f5f03b5a-6bda-408c-8638-297fd127afce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45d5555-bc36-4711-931f-63e3d1313d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45d5555-bc36-4711-931f-63e3d1313d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2139385923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51ac6bcf-f3da-4694-905f-e8b02b38378b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6547b825dcc64b6cad9825ae7680a12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:10:36Z,use_quota=True,user_id='7df3bb3e97a746fbb8f425d9e39e806c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddbd8f6e-0e16-4e13-96d5-f72ff202c6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddbd8f6e-0e16-4e13-96d5-f72ff202c6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635a0106-5f3f-43ae-91f1-03e80bd3b2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635a0106-5f3f-43ae-91f1-03e80bd3b2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51ac6bcf-f3da-4694-905f-e8b02b38378b', 'volume_name': 'volume-51ac6bcf-f3da-4694-905f-e8b02b38378b', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b81d6d6-b646-4278-be54-4136bbd00795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b81d6d6-b646-4278-be54-4136bbd00795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42dbc8cc-01b8-4dd4-995c-56176cbee6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:36 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Volume 51ac6bcf-f3da-4694-905f-e8b02b38378b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51ac6bcf-f3da-4694-905f-e8b02b38378b', 'volume_size': 1}
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2139385923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51ac6bcf-f3da-4694-905f-e8b02b38378b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6547b825dcc64b6cad9825ae7680a12c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:10:36Z,use_quota=True,user_id='7df3bb3e97a746fbb8f425d9e39e806c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Creating volume 51ac6bcf-f3da-4694-905f-e8b02b38378b {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:10:36 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:10:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-51ac6bcf-f3da-4694-905f-e8b02b38378b 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:10:36 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=7, name=volume-51ac6bcf-f3da-4694-905f-e8b02b38378b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:10:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-51ac6bcf-f3da-4694-905f-e8b02b38378b 1073741824" returned: 0 in 0.645s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:10:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-51ac6bcf-f3da-4694-905f-e8b02b38378b {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:10:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-51ac6bcf-f3da-4694-905f-e8b02b38378b" returned: 0 in 0.216s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:10:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] <== create_volume: return (1022ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:10:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:10:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42dbc8cc-01b8-4dd4-995c-56176cbee6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51ac6bcf-f3da-4694-905f-e8b02b38378b', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac33e80e-8f4f-4dab-a66b-ae7bae63b137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:37 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Volume volume-51ac6bcf-f3da-4694-905f-e8b02b38378b (51ac6bcf-f3da-4694-905f-e8b02b38378b): created successfully
Sep 22 23:10:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac33e80e-8f4f-4dab-a66b-ae7bae63b137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Flow 'volume_create_manager' (f5f03b5a-6bda-408c-8638-297fd127afce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:10:37 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-b04ce142-c617-48f3-8f48-850e113e944f tempest-TaggedBootDevicesTest-816810426 None] Created volume successfully.
Sep 22 23:10:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:10:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:10:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:10:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:10:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:10:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:10:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:10:48 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:10:48 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=10,cinder:SELECT=15,cinder:INSERT=12,cinder:DELETE=2 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:10:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.635s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:10:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:10:59 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Flow 'volume_create_manager' (b97f0627-bc3b-40e1-991d-0f7f36a7fcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6cdc02c-f679-4c47-9238-696b1de70182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6cdc02c-f679-4c47-9238-696b1de70182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1773180717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a69bcec-ba83-4eb4-bd60-15847883032b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217d09eb227b428c92febf864acdac94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:10:59Z,use_quota=True,user_id='6f9edf5f5c3e4f8ea0c678c225116ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9a84e7-6e00-43f3-80d0-f9a505deaa12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9a84e7-6e00-43f3-80d0-f9a505deaa12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a2e5ae-9c68-4fc2-ae04-24a29fc65783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a2e5ae-9c68-4fc2-ae04-24a29fc65783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a69bcec-ba83-4eb4-bd60-15847883032b', 'volume_name': 'volume-2a69bcec-ba83-4eb4-bd60-15847883032b', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9486426-c372-492f-b9b3-0de02416ea59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9486426-c372-492f-b9b3-0de02416ea59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09757141-8d5b-4a27-81ba-9ddcd59b43bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:10:59 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Volume 2a69bcec-ba83-4eb4-bd60-15847883032b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a69bcec-ba83-4eb4-bd60-15847883032b', 'volume_size': 1}
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1773180717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a69bcec-ba83-4eb4-bd60-15847883032b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217d09eb227b428c92febf864acdac94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:10:59Z,use_quota=True,user_id='6f9edf5f5c3e4f8ea0c678c225116ecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Creating volume 2a69bcec-ba83-4eb4-bd60-15847883032b {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:10:59 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:10:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2a69bcec-ba83-4eb4-bd60-15847883032b 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:10:59 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=8, name=volume-2a69bcec-ba83-4eb4-bd60-15847883032b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:11:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2a69bcec-ba83-4eb4-bd60-15847883032b 1073741824" returned: 0 in 0.580s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:11:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2a69bcec-ba83-4eb4-bd60-15847883032b {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:11:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2a69bcec-ba83-4eb4-bd60-15847883032b" returned: 0 in 0.168s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:11:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] <== create_volume: return (894ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:11:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:11:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09757141-8d5b-4a27-81ba-9ddcd59b43bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a69bcec-ba83-4eb4-bd60-15847883032b', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:11:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d59145-c9dc-4479-b49f-87d65900b3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:11:01 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Volume volume-2a69bcec-ba83-4eb4-bd60-15847883032b (2a69bcec-ba83-4eb4-bd60-15847883032b): created successfully
Sep 22 23:11:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d59145-c9dc-4479-b49f-87d65900b3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:11:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Flow 'volume_create_manager' (b97f0627-bc3b-40e1-991d-0f7f36a7fcd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:11:01 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-5608981a-85e9-4b6e-ad8c-5214b12995de tempest-VolumesAdminNegativeTest-661813662 None] Created volume successfully.
Sep 22 23:11:02 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-142329fc-f5ad-4847-aed4-d4b05b9d6c42 tempest-VolumesAdminNegativeTest-661813662 None] Acquiring lock "cinder-2a69bcec-ba83-4eb4-bd60-15847883032b-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:11:02 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-142329fc-f5ad-4847-aed4-d4b05b9d6c42 tempest-VolumesAdminNegativeTest-661813662 None] Lock "cinder-2a69bcec-ba83-4eb4-bd60-15847883032b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:11:02 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-142329fc-f5ad-4847-aed4-d4b05b9d6c42 tempest-VolumesAdminNegativeTest-661813662 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:11:02 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-142329fc-f5ad-4847-aed4-d4b05b9d6c42 tempest-VolumesAdminNegativeTest-661813662 None] Acquiring lock "cinder-quobyte-2a69bcec-ba83-4eb4-bd60-15847883032b" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:11:02 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-142329fc-f5ad-4847-aed4-d4b05b9d6c42 tempest-VolumesAdminNegativeTest-661813662 None] Lock "cinder-quobyte-2a69bcec-ba83-4eb4-bd60-15847883032b" acquired by "delete_volume" :: waited 0.049s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:11:02 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9c950e-e91d-43ce-bac6-a783f38affc8]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:11:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-142329fc-f5ad-4847-aed4-d4b05b9d6c42 tempest-VolumesAdminNegativeTest-661813662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2a69bcec-ba83-4eb4-bd60-15847883032b {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:11:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-142329fc-f5ad-4847-aed4-d4b05b9d6c42 tempest-VolumesAdminNegativeTest-661813662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2a69bcec-ba83-4eb4-bd60-15847883032b" returned: 0 in 1.150s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:11:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-142329fc-f5ad-4847-aed4-d4b05b9d6c42 tempest-VolumesAdminNegativeTest-661813662 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2a69bcec-ba83-4eb4-bd60-15847883032b {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:11:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-142329fc-f5ad-4847-aed4-d4b05b9d6c42 tempest-VolumesAdminNegativeTest-661813662 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2a69bcec-ba83-4eb4-bd60-15847883032b" returned: 0 in 0.225s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:11:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-142329fc-f5ad-4847-aed4-d4b05b9d6c42 tempest-VolumesAdminNegativeTest-661813662 None] Lock "cinder-quobyte-2a69bcec-ba83-4eb4-bd60-15847883032b" released by "delete_volume" :: held 1.942s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:11:05 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-142329fc-f5ad-4847-aed4-d4b05b9d6c42 tempest-VolumesAdminNegativeTest-661813662 None] Created reservations ['de0555d2-372c-4a32-8371-89021e4c330d', '22a95675-be7d-4073-9844-914e8b706938', 'd8920524-edbf-41b4-ba52-96c2b2b5aff4', 'a8fb0c44-b7ae-4813-ad6d-2fe8ba93d435'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:11:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-142329fc-f5ad-4847-aed4-d4b05b9d6c42 tempest-VolumesAdminNegativeTest-661813662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:11:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-142329fc-f5ad-4847-aed4-d4b05b9d6c42 tempest-VolumesAdminNegativeTest-661813662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:11:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-142329fc-f5ad-4847-aed4-d4b05b9d6c42 tempest-VolumesAdminNegativeTest-661813662 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:11:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-142329fc-f5ad-4847-aed4-d4b05b9d6c42 tempest-VolumesAdminNegativeTest-661813662 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:11:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-142329fc-f5ad-4847-aed4-d4b05b9d6c42 tempest-VolumesAdminNegativeTest-661813662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:11:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-142329fc-f5ad-4847-aed4-d4b05b9d6c42 tempest-VolumesAdminNegativeTest-661813662 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:11:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-142329fc-f5ad-4847-aed4-d4b05b9d6c42 tempest-VolumesAdminNegativeTest-661813662 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.253s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:11:06 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-142329fc-f5ad-4847-aed4-d4b05b9d6c42 tempest-VolumesAdminNegativeTest-661813662 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:11:06 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-142329fc-f5ad-4847-aed4-d4b05b9d6c42 tempest-VolumesAdminNegativeTest-661813662 None] Deleted volume successfully.
Sep 22 23:11:08 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-142329fc-f5ad-4847-aed4-d4b05b9d6c42 tempest-VolumesAdminNegativeTest-661813662 None] Lock "cinder-2a69bcec-ba83-4eb4-bd60-15847883032b-delete_volume" released by "delete_volume" :: held 5.774s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:11:15 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=19,cinder:SELECT=6 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:11:17 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1,cinder:DELETE=2,cinder:INSERT=4 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:11:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-e89995e3-7008-4723-8a1a-2b15bb82da71 tempest-TaggedBootDevicesTest-816810426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:11:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-e89995e3-7008-4723-8a1a-2b15bb82da71 tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:11:19 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0521b9b0-d0b0-40ba-9027-8aa06e8211e7]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:11:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-e89995e3-7008-4723-8a1a-2b15bb82da71 tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:11:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-e89995e3-7008-4723-8a1a-2b15bb82da71 tempest-TaggedBootDevicesTest-816810426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4" returned: 0 in 1.540s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:11:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-e89995e3-7008-4723-8a1a-2b15bb82da71 tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:11:21 devstack quobyte-client[84065]: System call of process 86600 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:11:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-e89995e3-7008-4723-8a1a-2b15bb82da71 tempest-TaggedBootDevicesTest-816810426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4" returned: 1 in 0.572s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:11:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-e89995e3-7008-4723-8a1a-2b15bb82da71 tempest-TaggedBootDevicesTest-816810426 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:11:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-e89995e3-7008-4723-8a1a-2b15bb82da71 tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.436s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:11:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-e89995e3-7008-4723-8a1a-2b15bb82da71 tempest-TaggedBootDevicesTest-816810426 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66e32f9d-c80e-4839-8609-107ef8ef676a', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:11:22 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-e89995e3-7008-4723-8a1a-2b15bb82da71 tempest-TaggedBootDevicesTest-816810426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:11:22 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-e89995e3-7008-4723-8a1a-2b15bb82da71 tempest-TaggedBootDevicesTest-816810426 None] attachment_update completed successfully.
Sep 22 23:11:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-274a5750-7162-4f2d-98f9-aa6d0c502310 tempest-TaggedBootDevicesTest-816810426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:11:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-274a5750-7162-4f2d-98f9-aa6d0c502310 tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.017s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:11:27 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b65162-8444-4f1d-ab38-9b6f6db2b2c0]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:11:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-274a5750-7162-4f2d-98f9-aa6d0c502310 tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8f449de4-a764-4fbe-8add-48706f79684c {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:11:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-274a5750-7162-4f2d-98f9-aa6d0c502310 tempest-TaggedBootDevicesTest-816810426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8f449de4-a764-4fbe-8add-48706f79684c" returned: 0 in 1.461s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:11:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-274a5750-7162-4f2d-98f9-aa6d0c502310 tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.642s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:11:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-274a5750-7162-4f2d-98f9-aa6d0c502310 tempest-TaggedBootDevicesTest-816810426 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-8f449de4-a764-4fbe-8add-48706f79684c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22d3abfc-181b-498c-bcb9-5f0fc927079e', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:11:30 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-274a5750-7162-4f2d-98f9-aa6d0c502310 tempest-TaggedBootDevicesTest-816810426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:11:31 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-274a5750-7162-4f2d-98f9-aa6d0c502310 tempest-TaggedBootDevicesTest-816810426 None] attachment_update completed successfully.
Sep 22 23:11:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-250df19c-c903-41bd-bff7-505faa3b3e03 tempest-TaggedBootDevicesTest-816810426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:11:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-250df19c-c903-41bd-bff7-505faa3b3e03 tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:11:37 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0d1046-c4f9-4f28-959d-f8c7e66711c3]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:11:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-250df19c-c903-41bd-bff7-505faa3b3e03 tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-51ac6bcf-f3da-4694-905f-e8b02b38378b {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:11:39 devstack quobyte-client[84065]: System call of process 86638 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:11:39 devstack quobyte-client[84065]: System call of process 86638 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:11:39 devstack quobyte-client[84065]: System call of process 86638 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:11:39 devstack quobyte-client[84065]: System call of process 86638 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:11:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-250df19c-c903-41bd-bff7-505faa3b3e03 tempest-TaggedBootDevicesTest-816810426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-51ac6bcf-f3da-4694-905f-e8b02b38378b" returned: 0 in 2.132s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:11:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-250df19c-c903-41bd-bff7-505faa3b3e03 tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.414s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:11:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-250df19c-c903-41bd-bff7-505faa3b3e03 tempest-TaggedBootDevicesTest-816810426 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-51ac6bcf-f3da-4694-905f-e8b02b38378b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ffeaebe-09d0-4e16-8193-fdf6b421c3e1', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:11:40 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-250df19c-c903-41bd-bff7-505faa3b3e03 tempest-TaggedBootDevicesTest-816810426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:11:40 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-f5aa94c1-767f-4c30-a226-94f23fc4ee2f req-250df19c-c903-41bd-bff7-505faa3b3e03 tempest-TaggedBootDevicesTest-816810426 None] attachment_update completed successfully.
Sep 22 23:11:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:11:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:11:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:11:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:11:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:11:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:11:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:11:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.150s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:11:47 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:11:50 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=16,cinder:UPDATE=2 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:11:50 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=17,cinder:UPDATE=7 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:12:29 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:12:37 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:12:37 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:12:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Flow 'volume_create_manager' (0b3f71d7-7a86-4b8c-9683-c070e0c36d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:12:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b53ecdf-ceb9-474d-a837-6c22221dc05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:12:38 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b53ecdf-ceb9-474d-a837-6c22221dc05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1126476988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c56b77d4-0c7b-4af0-81a9-5784af3d451b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea934ba906b4cc59a51833c47636344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:12:37Z,use_quota=True,user_id='58739040741847d8a1bc046198a4f58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:12:38 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2392e96-d36c-49a2-a98e-72f6dd5b0660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:12:38 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2392e96-d36c-49a2-a98e-72f6dd5b0660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:12:38 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41117364-a9e0-4499-8ff1-bf3d8f70b3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:12:38 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41117364-a9e0-4499-8ff1-bf3d8f70b3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c56b77d4-0c7b-4af0-81a9-5784af3d451b', 'volume_name': 'volume-c56b77d4-0c7b-4af0-81a9-5784af3d451b', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:12:38 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd79329-eb65-427a-a130-a728d21ded57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:12:38 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd79329-eb65-427a-a130-a728d21ded57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:12:38 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26d1f2b-f77c-44ad-9b9c-e829cb6d1359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:12:38 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Volume c56b77d4-0c7b-4af0-81a9-5784af3d451b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c56b77d4-0c7b-4af0-81a9-5784af3d451b', 'volume_size': 1}
Sep 22 23:12:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:12:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:12:38 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1126476988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c56b77d4-0c7b-4af0-81a9-5784af3d451b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea934ba906b4cc59a51833c47636344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:12:37Z,use_quota=True,user_id='58739040741847d8a1bc046198a4f58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:12:38 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Creating volume c56b77d4-0c7b-4af0-81a9-5784af3d451b {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:12:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:12:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:12:38 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:12:38 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:12:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:12:38 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:12:38 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:12:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c56b77d4-0c7b-4af0-81a9-5784af3d451b 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:12:38 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=9, name=volume-c56b77d4-0c7b-4af0-81a9-5784af3d451b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:12:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c56b77d4-0c7b-4af0-81a9-5784af3d451b 1073741824" returned: 0 in 1.178s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:12:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c56b77d4-0c7b-4af0-81a9-5784af3d451b {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:12:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c56b77d4-0c7b-4af0-81a9-5784af3d451b" returned: 0 in 0.854s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:12:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] <== create_volume: return (2254ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:12:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.280s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:12:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26d1f2b-f77c-44ad-9b9c-e829cb6d1359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c56b77d4-0c7b-4af0-81a9-5784af3d451b', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:12:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81fabe9c-775e-41ec-869e-6018f3dd18b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:12:41 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Volume volume-c56b77d4-0c7b-4af0-81a9-5784af3d451b (c56b77d4-0c7b-4af0-81a9-5784af3d451b): created successfully
Sep 22 23:12:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81fabe9c-775e-41ec-869e-6018f3dd18b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:12:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Flow 'volume_create_manager' (0b3f71d7-7a86-4b8c-9683-c070e0c36d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:12:41 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-3fb267a4-3bc6-432a-ac48-a198ffdcee09 tempest-ServersNegativeTestJSON-636332658 None] Created volume successfully.
Sep 22 23:12:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:12:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:12:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:12:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:12:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:12:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.071s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:12:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:12:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.525s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:12:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:12:50 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:12:50 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:12:50 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Flow 'volume_create_manager' (ddd7b867-0e42-42bf-aeba-72996af106e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:12:50 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c7f563-8efc-44c7-b2fa-ac2739404f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:12:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c7f563-8efc-44c7-b2fa-ac2739404f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1466322871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d6a47d1-f586-49a5-82f2-02652085da63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea934ba906b4cc59a51833c47636344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:12:48Z,use_quota=True,user_id='58739040741847d8a1bc046198a4f58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:12:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27841d6c-5ef8-4f47-953f-50b741aa06c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:12:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27841d6c-5ef8-4f47-953f-50b741aa06c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:12:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0449228-ff26-4c79-a04a-ff740c6a1a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:12:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0449228-ff26-4c79-a04a-ff740c6a1a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d6a47d1-f586-49a5-82f2-02652085da63', 'volume_name': 'volume-5d6a47d1-f586-49a5-82f2-02652085da63', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:12:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c073d3e0-c1ec-4401-b4df-30b758122075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:12:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c073d3e0-c1ec-4401-b4df-30b758122075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:12:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (229eee26-f585-4b44-82bb-f0b4f863e96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:12:51 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Volume 5d6a47d1-f586-49a5-82f2-02652085da63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d6a47d1-f586-49a5-82f2-02652085da63', 'volume_size': 1}
Sep 22 23:12:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:12:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:12:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1466322871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d6a47d1-f586-49a5-82f2-02652085da63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea934ba906b4cc59a51833c47636344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:12:48Z,use_quota=True,user_id='58739040741847d8a1bc046198a4f58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:12:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Creating volume 5d6a47d1-f586-49a5-82f2-02652085da63 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:12:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:12:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:12:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:12:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:12:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:12:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:12:51 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:12:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d6a47d1-f586-49a5-82f2-02652085da63 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:12:51 devstack quobyte-client[84065]: System call of process 87681 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:12:51 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=10, name=volume-5d6a47d1-f586-49a5-82f2-02652085da63, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:12:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d6a47d1-f586-49a5-82f2-02652085da63 1073741824" returned: 0 in 0.967s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:12:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d6a47d1-f586-49a5-82f2-02652085da63 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:12:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d6a47d1-f586-49a5-82f2-02652085da63" returned: 0 in 0.207s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:12:52 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] <== create_volume: return (1564ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:12:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:12:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (229eee26-f585-4b44-82bb-f0b4f863e96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d6a47d1-f586-49a5-82f2-02652085da63', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:12:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79ffe08-6e1c-47ca-b86e-70d6e5a5b6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:12:54 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Volume volume-5d6a47d1-f586-49a5-82f2-02652085da63 (5d6a47d1-f586-49a5-82f2-02652085da63): created successfully
Sep 22 23:12:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79ffe08-6e1c-47ca-b86e-70d6e5a5b6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:12:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Flow 'volume_create_manager' (ddd7b867-0e42-42bf-aeba-72996af106e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:12:55 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-dd8ec516-0578-4a13-839e-0430a837d5dd tempest-ServersNegativeTestJSON-636332658 None] Created volume successfully.
Sep 22 23:12:56 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6f83f629-1502-4a34-bf80-1f1a85739bc4 tempest-ServersNegativeTestJSON-636332658 None] Acquiring lock "cinder-5d6a47d1-f586-49a5-82f2-02652085da63-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:12:56 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6f83f629-1502-4a34-bf80-1f1a85739bc4 tempest-ServersNegativeTestJSON-636332658 None] Lock "cinder-5d6a47d1-f586-49a5-82f2-02652085da63-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:12:57 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-6f83f629-1502-4a34-bf80-1f1a85739bc4 tempest-ServersNegativeTestJSON-636332658 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:12:57 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6f83f629-1502-4a34-bf80-1f1a85739bc4 tempest-ServersNegativeTestJSON-636332658 None] Acquiring lock "cinder-quobyte-5d6a47d1-f586-49a5-82f2-02652085da63" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:12:57 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6f83f629-1502-4a34-bf80-1f1a85739bc4 tempest-ServersNegativeTestJSON-636332658 None] Lock "cinder-quobyte-5d6a47d1-f586-49a5-82f2-02652085da63" acquired by "delete_volume" :: waited 0.057s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:12:57 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[449da4f5-b35d-4b01-bc3b-9d061adddf21]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:12:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6f83f629-1502-4a34-bf80-1f1a85739bc4 tempest-ServersNegativeTestJSON-636332658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d6a47d1-f586-49a5-82f2-02652085da63 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:12:59 devstack quobyte-client[84065]: System call of process 87708 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:12:59 devstack quobyte-client[84065]: System call of process 87708 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:12:59 devstack quobyte-client[84065]: System call of process 87708 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:13:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6f83f629-1502-4a34-bf80-1f1a85739bc4 tempest-ServersNegativeTestJSON-636332658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d6a47d1-f586-49a5-82f2-02652085da63" returned: 0 in 2.720s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:13:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6f83f629-1502-4a34-bf80-1f1a85739bc4 tempest-ServersNegativeTestJSON-636332658 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d6a47d1-f586-49a5-82f2-02652085da63 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:13:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6f83f629-1502-4a34-bf80-1f1a85739bc4 tempest-ServersNegativeTestJSON-636332658 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d6a47d1-f586-49a5-82f2-02652085da63" returned: 0 in 0.496s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:13:01 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6f83f629-1502-4a34-bf80-1f1a85739bc4 tempest-ServersNegativeTestJSON-636332658 None] Lock "cinder-quobyte-5d6a47d1-f586-49a5-82f2-02652085da63" released by "delete_volume" :: held 3.778s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:13:03 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-6f83f629-1502-4a34-bf80-1f1a85739bc4 tempest-ServersNegativeTestJSON-636332658 None] Created reservations ['a93d8d6b-988e-471d-b7c0-c7467f82a736', '4c80c01f-c79b-449e-9815-60f4ff671e9a', 'dc52f672-ecc9-44fa-a095-1fd878cd16a4', '6cfb50ee-9b8e-4728-8c1a-74761b435fd8'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:13:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6f83f629-1502-4a34-bf80-1f1a85739bc4 tempest-ServersNegativeTestJSON-636332658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:13:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6f83f629-1502-4a34-bf80-1f1a85739bc4 tempest-ServersNegativeTestJSON-636332658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:13:04 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6f83f629-1502-4a34-bf80-1f1a85739bc4 tempest-ServersNegativeTestJSON-636332658 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:13:04 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6f83f629-1502-4a34-bf80-1f1a85739bc4 tempest-ServersNegativeTestJSON-636332658 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:13:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6f83f629-1502-4a34-bf80-1f1a85739bc4 tempest-ServersNegativeTestJSON-636332658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.064s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:13:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6f83f629-1502-4a34-bf80-1f1a85739bc4 tempest-ServersNegativeTestJSON-636332658 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:13:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6f83f629-1502-4a34-bf80-1f1a85739bc4 tempest-ServersNegativeTestJSON-636332658 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.468s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:13:05 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-6f83f629-1502-4a34-bf80-1f1a85739bc4 tempest-ServersNegativeTestJSON-636332658 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:13:06 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-6f83f629-1502-4a34-bf80-1f1a85739bc4 tempest-ServersNegativeTestJSON-636332658 None] Deleted volume successfully.
Sep 22 23:13:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0602544c-d34b-4767-bc70-beff0b71d94b tempest-ServersNegativeTestJSON-636332658 None] Acquiring lock "cinder-c56b77d4-0c7b-4af0-81a9-5784af3d451b-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:13:07 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0602544c-d34b-4767-bc70-beff0b71d94b tempest-ServersNegativeTestJSON-636332658 None] Lock "cinder-c56b77d4-0c7b-4af0-81a9-5784af3d451b-delete_volume" acquired by "delete_volume" :: waited 0.505s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:13:07 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6f83f629-1502-4a34-bf80-1f1a85739bc4 tempest-ServersNegativeTestJSON-636332658 None] Lock "cinder-5d6a47d1-f586-49a5-82f2-02652085da63-delete_volume" released by "delete_volume" :: held 10.314s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:13:07 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-0602544c-d34b-4767-bc70-beff0b71d94b tempest-ServersNegativeTestJSON-636332658 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:13:07 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0602544c-d34b-4767-bc70-beff0b71d94b tempest-ServersNegativeTestJSON-636332658 None] Acquiring lock "cinder-quobyte-c56b77d4-0c7b-4af0-81a9-5784af3d451b" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:13:07 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0602544c-d34b-4767-bc70-beff0b71d94b tempest-ServersNegativeTestJSON-636332658 None] Lock "cinder-quobyte-c56b77d4-0c7b-4af0-81a9-5784af3d451b" acquired by "delete_volume" :: waited 0.032s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:13:08 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab83e7eb-b1d8-4a54-9f9a-09b97b116a70]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:13:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0602544c-d34b-4767-bc70-beff0b71d94b tempest-ServersNegativeTestJSON-636332658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c56b77d4-0c7b-4af0-81a9-5784af3d451b {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:13:09 devstack quobyte-client[84065]: System call of process 87785 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:13:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0602544c-d34b-4767-bc70-beff0b71d94b tempest-ServersNegativeTestJSON-636332658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c56b77d4-0c7b-4af0-81a9-5784af3d451b" returned: 0 in 1.720s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:13:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0602544c-d34b-4767-bc70-beff0b71d94b tempest-ServersNegativeTestJSON-636332658 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c56b77d4-0c7b-4af0-81a9-5784af3d451b {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:13:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0602544c-d34b-4767-bc70-beff0b71d94b tempest-ServersNegativeTestJSON-636332658 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c56b77d4-0c7b-4af0-81a9-5784af3d451b" returned: 0 in 0.290s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:13:10 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0602544c-d34b-4767-bc70-beff0b71d94b tempest-ServersNegativeTestJSON-636332658 None] Lock "cinder-quobyte-c56b77d4-0c7b-4af0-81a9-5784af3d451b" released by "delete_volume" :: held 2.814s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:13:11 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-0602544c-d34b-4767-bc70-beff0b71d94b tempest-ServersNegativeTestJSON-636332658 None] Created reservations ['0b3c269d-ec16-4395-881b-14f85710e622', '19aff4c3-59bd-4222-8d85-2cac48145810', '2b875504-d688-4a94-ae7c-0b7cbe3b5d6c', 'a2d2f4f1-ac4f-482b-b280-d976b69865c4'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:13:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0602544c-d34b-4767-bc70-beff0b71d94b tempest-ServersNegativeTestJSON-636332658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:13:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0602544c-d34b-4767-bc70-beff0b71d94b tempest-ServersNegativeTestJSON-636332658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:13:12 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0602544c-d34b-4767-bc70-beff0b71d94b tempest-ServersNegativeTestJSON-636332658 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:13:12 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0602544c-d34b-4767-bc70-beff0b71d94b tempest-ServersNegativeTestJSON-636332658 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:13:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0602544c-d34b-4767-bc70-beff0b71d94b tempest-ServersNegativeTestJSON-636332658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.109s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:13:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0602544c-d34b-4767-bc70-beff0b71d94b tempest-ServersNegativeTestJSON-636332658 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:13:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0602544c-d34b-4767-bc70-beff0b71d94b tempest-ServersNegativeTestJSON-636332658 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.358s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:13:12 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-0602544c-d34b-4767-bc70-beff0b71d94b tempest-ServersNegativeTestJSON-636332658 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:13:13 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-0602544c-d34b-4767-bc70-beff0b71d94b tempest-ServersNegativeTestJSON-636332658 None] Deleted volume successfully.
Sep 22 23:13:13 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0602544c-d34b-4767-bc70-beff0b71d94b tempest-ServersNegativeTestJSON-636332658 None] Lock "cinder-c56b77d4-0c7b-4af0-81a9-5784af3d451b-delete_volume" released by "delete_volume" :: held 6.589s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:13:22 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=17,cinder:DELETE=3,cinder:SELECT=12,cinder:INSERT=5 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:13:23 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=12,cinder:UPDATE=23,cinder:INSERT=3,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:13:39 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Flow 'volume_create_manager' (68b0c43c-26c6-4949-8ba9-4302ab503be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a642e15-df85-4fc4-b382-37dd6f655349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a642e15-df85-4fc4-b382-37dd6f655349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1674177749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3fb77a-3373-4e46-8cf1-369ad1c2f14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a9f5ed73104163a733e11230975b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:13:39Z,use_quota=True,user_id='735142a6a0c14c238b9c3336627402a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e50ffc7-5581-4d0d-9b0b-e86b66d46900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e50ffc7-5581-4d0d-9b0b-e86b66d46900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a279b1-b327-43ff-b325-4fdab98cd6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a279b1-b327-43ff-b325-4fdab98cd6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb3fb77a-3373-4e46-8cf1-369ad1c2f14f', 'volume_name': 'volume-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26600038-d0a3-4baf-8030-b8d057e5dd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26600038-d0a3-4baf-8030-b8d057e5dd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95640e8-55a0-4994-a210-c4d03fd130d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:13:39 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Volume bb3fb77a-3373-4e46-8cf1-369ad1c2f14f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f', 'volume_size': 1}
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1674177749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3fb77a-3373-4e46-8cf1-369ad1c2f14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a9f5ed73104163a733e11230975b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:13:39Z,use_quota=True,user_id='735142a6a0c14c238b9c3336627402a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Creating volume bb3fb77a-3373-4e46-8cf1-369ad1c2f14f {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.065s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:13:39 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:13:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:13:40 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=11, name=volume-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:13:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f 1073741824" returned: 0 in 0.995s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:13:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:13:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f" returned: 0 in 0.254s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:13:41 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] <== create_volume: return (1467ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:13:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:13:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95640e8-55a0-4994-a210-c4d03fd130d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:13:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7762ca1e-fae2-43fc-97c5-95e0553131dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:13:41 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Volume volume-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f (bb3fb77a-3373-4e46-8cf1-369ad1c2f14f): created successfully
Sep 22 23:13:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7762ca1e-fae2-43fc-97c5-95e0553131dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:13:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Flow 'volume_create_manager' (68b0c43c-26c6-4949-8ba9-4302ab503be6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:13:41 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-3ba0669e-c94b-4b1a-b1f7-e81c346731df tempest-DeleteServersTestJSON-908495716 None] Created volume successfully.
Sep 22 23:13:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:13:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:13:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:13:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:13:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:13:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:13:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:13:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 1.105s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:13:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:13:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-e4824013-b899-42a8-8ee7-ce96da628bdd req-ca0e6541-95f0-4e81-b8fe-014347cfe5d4 tempest-DeleteServersTestJSON-908495716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:13:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-e4824013-b899-42a8-8ee7-ce96da628bdd req-ca0e6541-95f0-4e81-b8fe-014347cfe5d4 tempest-DeleteServersTestJSON-908495716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:13:49 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a4b8cf-67ec-4f17-98a5-603db96a6aa8]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:13:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-e4824013-b899-42a8-8ee7-ce96da628bdd req-ca0e6541-95f0-4e81-b8fe-014347cfe5d4 tempest-DeleteServersTestJSON-908495716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:13:49 devstack quobyte-client[84065]: System call of process 87981 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:13:49 devstack quobyte-client[84065]: System call of process 87981 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:13:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-e4824013-b899-42a8-8ee7-ce96da628bdd req-ca0e6541-95f0-4e81-b8fe-014347cfe5d4 tempest-DeleteServersTestJSON-908495716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f" returned: 0 in 0.971s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:13:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-e4824013-b899-42a8-8ee7-ce96da628bdd req-ca0e6541-95f0-4e81-b8fe-014347cfe5d4 tempest-DeleteServersTestJSON-908495716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.176s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:13:50 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-e4824013-b899-42a8-8ee7-ce96da628bdd req-ca0e6541-95f0-4e81-b8fe-014347cfe5d4 tempest-DeleteServersTestJSON-908495716 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14071d0e-6184-4b62-ad91-7a14798d6ae3', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:13:50 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-e4824013-b899-42a8-8ee7-ce96da628bdd req-ca0e6541-95f0-4e81-b8fe-014347cfe5d4 tempest-DeleteServersTestJSON-908495716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:13:51 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-e4824013-b899-42a8-8ee7-ce96da628bdd req-ca0e6541-95f0-4e81-b8fe-014347cfe5d4 tempest-DeleteServersTestJSON-908495716 None] attachment_update completed successfully.
Sep 22 23:14:01 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:14:01 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:14:06 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-1ed1abac-7a92-49cf-97cc-5effa05fa499 req-ab759b47-acb4-4990-b4ee-8eebeaa9c210 tempest-DeleteServersTestJSON-908495716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:14:06 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-1ed1abac-7a92-49cf-97cc-5effa05fa499 req-ab759b47-acb4-4990-b4ee-8eebeaa9c210 tempest-DeleteServersTestJSON-908495716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:14:06 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-1ed1abac-7a92-49cf-97cc-5effa05fa499 req-ab759b47-acb4-4990-b4ee-8eebeaa9c210 tempest-DeleteServersTestJSON-908495716 None] Terminate volume connection completed successfully.
Sep 22 23:14:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-1ed1abac-7a92-49cf-97cc-5effa05fa499 req-ab759b47-acb4-4990-b4ee-8eebeaa9c210 tempest-DeleteServersTestJSON-908495716 None] Deleting attachment 14071d0e-6184-4b62-ad91-7a14798d6ae3. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:14:11 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b4499a2c-6ca1-4324-90dc-74a6f472e135 tempest-DeleteServersTestJSON-908495716 None] Acquiring lock "cinder-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:14:11 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b4499a2c-6ca1-4324-90dc-74a6f472e135 tempest-DeleteServersTestJSON-908495716 None] Lock "cinder-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:14:11 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-b4499a2c-6ca1-4324-90dc-74a6f472e135 tempest-DeleteServersTestJSON-908495716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:14:11 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b4499a2c-6ca1-4324-90dc-74a6f472e135 tempest-DeleteServersTestJSON-908495716 None] Acquiring lock "cinder-quobyte-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:14:11 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b4499a2c-6ca1-4324-90dc-74a6f472e135 tempest-DeleteServersTestJSON-908495716 None] Lock "cinder-quobyte-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f" acquired by "delete_volume" :: waited 0.027s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:14:11 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f55a16-9569-45ae-8a1d-04d03697bd79]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:14:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b4499a2c-6ca1-4324-90dc-74a6f472e135 tempest-DeleteServersTestJSON-908495716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:14:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b4499a2c-6ca1-4324-90dc-74a6f472e135 tempest-DeleteServersTestJSON-908495716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f" returned: 0 in 0.654s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:14:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b4499a2c-6ca1-4324-90dc-74a6f472e135 tempest-DeleteServersTestJSON-908495716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:14:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b4499a2c-6ca1-4324-90dc-74a6f472e135 tempest-DeleteServersTestJSON-908495716 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f" returned: 0 in 0.180s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:14:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b4499a2c-6ca1-4324-90dc-74a6f472e135 tempest-DeleteServersTestJSON-908495716 None] Lock "cinder-quobyte-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f" released by "delete_volume" :: held 1.138s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:14:12 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-b4499a2c-6ca1-4324-90dc-74a6f472e135 tempest-DeleteServersTestJSON-908495716 None] Created reservations ['090f5fc2-6ed5-46c9-b5cf-c50ab9fbb85a', 'f3e2b621-7c95-4031-afeb-96d7c522b170', '011eb3aa-8be7-4e24-8f2a-af24b5f31805', 'e000bb39-f6ee-4b21-a1ff-c5fa628c40a8'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:14:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b4499a2c-6ca1-4324-90dc-74a6f472e135 tempest-DeleteServersTestJSON-908495716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:14:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b4499a2c-6ca1-4324-90dc-74a6f472e135 tempest-DeleteServersTestJSON-908495716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:14:13 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b4499a2c-6ca1-4324-90dc-74a6f472e135 tempest-DeleteServersTestJSON-908495716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:14:13 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b4499a2c-6ca1-4324-90dc-74a6f472e135 tempest-DeleteServersTestJSON-908495716 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:14:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b4499a2c-6ca1-4324-90dc-74a6f472e135 tempest-DeleteServersTestJSON-908495716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:14:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b4499a2c-6ca1-4324-90dc-74a6f472e135 tempest-DeleteServersTestJSON-908495716 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:14:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b4499a2c-6ca1-4324-90dc-74a6f472e135 tempest-DeleteServersTestJSON-908495716 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.115s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:14:13 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-b4499a2c-6ca1-4324-90dc-74a6f472e135 tempest-DeleteServersTestJSON-908495716 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:14:13 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-b4499a2c-6ca1-4324-90dc-74a6f472e135 tempest-DeleteServersTestJSON-908495716 None] Deleted volume successfully.
Sep 22 23:14:13 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b4499a2c-6ca1-4324-90dc-74a6f472e135 tempest-DeleteServersTestJSON-908495716 None] Lock "cinder-bb3fb77a-3373-4e46-8cf1-369ad1c2f14f-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:14:28 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:14:28 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:14:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:14:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:14:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:14:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:14:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:14:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.159s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:14:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:14:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.476s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:14:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:15:00 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-c868d221-39b5-471b-ae04-59810457ed42 req-9ee125a6-33fb-4345-8388-3e5ea828fad9 tempest-TaggedBootDevicesTest-816810426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:15:00 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-c868d221-39b5-471b-ae04-59810457ed42 req-9ee125a6-33fb-4345-8388-3e5ea828fad9 tempest-TaggedBootDevicesTest-816810426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:15:00 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-c868d221-39b5-471b-ae04-59810457ed42 req-9ee125a6-33fb-4345-8388-3e5ea828fad9 tempest-TaggedBootDevicesTest-816810426 None] Terminate volume connection completed successfully.
Sep 22 23:15:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c868d221-39b5-471b-ae04-59810457ed42 req-9ee125a6-33fb-4345-8388-3e5ea828fad9 tempest-TaggedBootDevicesTest-816810426 None] Deleting attachment 66e32f9d-c80e-4839-8609-107ef8ef676a. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:15:00 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-c868d221-39b5-471b-ae04-59810457ed42 req-4278e592-5b57-4690-a31d-52bbfd7c85d9 tempest-TaggedBootDevicesTest-816810426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:15:00 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-c868d221-39b5-471b-ae04-59810457ed42 req-4278e592-5b57-4690-a31d-52bbfd7c85d9 tempest-TaggedBootDevicesTest-816810426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:15:00 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-c868d221-39b5-471b-ae04-59810457ed42 req-4278e592-5b57-4690-a31d-52bbfd7c85d9 tempest-TaggedBootDevicesTest-816810426 None] Terminate volume connection completed successfully.
Sep 22 23:15:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c868d221-39b5-471b-ae04-59810457ed42 req-4278e592-5b57-4690-a31d-52bbfd7c85d9 tempest-TaggedBootDevicesTest-816810426 None] Deleting attachment 22d3abfc-181b-498c-bcb9-5f0fc927079e. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:15:01 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-c868d221-39b5-471b-ae04-59810457ed42 req-dc4d293d-88fb-4710-85d0-c89de8f37072 tempest-TaggedBootDevicesTest-816810426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:15:01 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-c868d221-39b5-471b-ae04-59810457ed42 req-dc4d293d-88fb-4710-85d0-c89de8f37072 tempest-TaggedBootDevicesTest-816810426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:15:01 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-c868d221-39b5-471b-ae04-59810457ed42 req-dc4d293d-88fb-4710-85d0-c89de8f37072 tempest-TaggedBootDevicesTest-816810426 None] Terminate volume connection completed successfully.
Sep 22 23:15:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c868d221-39b5-471b-ae04-59810457ed42 req-dc4d293d-88fb-4710-85d0-c89de8f37072 tempest-TaggedBootDevicesTest-816810426 None] Deleting attachment 0ffeaebe-09d0-4e16-8193-fdf6b421c3e1. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:15:11 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=3 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:15:11 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=3 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:15:16 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-537b4eee-de98-4a20-b2c5-2f61e41069ba tempest-TaggedBootDevicesTest-816810426 None] Acquiring lock "cinder-51ac6bcf-f3da-4694-905f-e8b02b38378b-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:15:16 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-537b4eee-de98-4a20-b2c5-2f61e41069ba tempest-TaggedBootDevicesTest-816810426 None] Lock "cinder-51ac6bcf-f3da-4694-905f-e8b02b38378b-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:15:16 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-537b4eee-de98-4a20-b2c5-2f61e41069ba tempest-TaggedBootDevicesTest-816810426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:15:16 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-537b4eee-de98-4a20-b2c5-2f61e41069ba tempest-TaggedBootDevicesTest-816810426 None] Acquiring lock "cinder-quobyte-51ac6bcf-f3da-4694-905f-e8b02b38378b" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:15:16 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-537b4eee-de98-4a20-b2c5-2f61e41069ba tempest-TaggedBootDevicesTest-816810426 None] Lock "cinder-quobyte-51ac6bcf-f3da-4694-905f-e8b02b38378b" acquired by "delete_volume" :: waited 0.018s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:15:16 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2994261-6aad-4008-9ef8-b3fefcf663a3]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:15:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-537b4eee-de98-4a20-b2c5-2f61e41069ba tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-51ac6bcf-f3da-4694-905f-e8b02b38378b {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:15:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-537b4eee-de98-4a20-b2c5-2f61e41069ba tempest-TaggedBootDevicesTest-816810426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-51ac6bcf-f3da-4694-905f-e8b02b38378b" returned: 0 in 0.618s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:15:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-537b4eee-de98-4a20-b2c5-2f61e41069ba tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-51ac6bcf-f3da-4694-905f-e8b02b38378b {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:15:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-537b4eee-de98-4a20-b2c5-2f61e41069ba tempest-TaggedBootDevicesTest-816810426 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-51ac6bcf-f3da-4694-905f-e8b02b38378b" returned: 0 in 0.137s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:15:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-537b4eee-de98-4a20-b2c5-2f61e41069ba tempest-TaggedBootDevicesTest-816810426 None] Lock "cinder-quobyte-51ac6bcf-f3da-4694-905f-e8b02b38378b" released by "delete_volume" :: held 1.164s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:15:18 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-537b4eee-de98-4a20-b2c5-2f61e41069ba tempest-TaggedBootDevicesTest-816810426 None] Created reservations ['405821b1-1591-488e-bcd1-753bc4b1a528', '55eeaf53-b42d-430c-b89f-0af61d10d015', '0683ce5f-cafb-47f0-9b76-34f5026fd0ae', '43c96f89-fcef-4256-b119-685e9e2387ea'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:15:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-537b4eee-de98-4a20-b2c5-2f61e41069ba tempest-TaggedBootDevicesTest-816810426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:15:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-537b4eee-de98-4a20-b2c5-2f61e41069ba tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:15:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-537b4eee-de98-4a20-b2c5-2f61e41069ba tempest-TaggedBootDevicesTest-816810426 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:15:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-537b4eee-de98-4a20-b2c5-2f61e41069ba tempest-TaggedBootDevicesTest-816810426 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:15:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-537b4eee-de98-4a20-b2c5-2f61e41069ba tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:15:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-537b4eee-de98-4a20-b2c5-2f61e41069ba tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:15:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a1801038-4ff5-4c27-b4af-1dcb305936ac tempest-TaggedBootDevicesTest-816810426 None] Acquiring lock "cinder-8f449de4-a764-4fbe-8add-48706f79684c-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:15:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-537b4eee-de98-4a20-b2c5-2f61e41069ba tempest-TaggedBootDevicesTest-816810426 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 2.114s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:15:21 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-537b4eee-de98-4a20-b2c5-2f61e41069ba tempest-TaggedBootDevicesTest-816810426 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:15:21 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a1801038-4ff5-4c27-b4af-1dcb305936ac tempest-TaggedBootDevicesTest-816810426 None] Lock "cinder-8f449de4-a764-4fbe-8add-48706f79684c-delete_volume" acquired by "delete_volume" :: waited 0.677s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:15:21 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-537b4eee-de98-4a20-b2c5-2f61e41069ba tempest-TaggedBootDevicesTest-816810426 None] Deleted volume successfully.
Sep 22 23:15:21 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-537b4eee-de98-4a20-b2c5-2f61e41069ba tempest-TaggedBootDevicesTest-816810426 None] Lock "cinder-51ac6bcf-f3da-4694-905f-e8b02b38378b-delete_volume" released by "delete_volume" :: held 5.327s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:15:22 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-a1801038-4ff5-4c27-b4af-1dcb305936ac tempest-TaggedBootDevicesTest-816810426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:15:22 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a1801038-4ff5-4c27-b4af-1dcb305936ac tempest-TaggedBootDevicesTest-816810426 None] Acquiring lock "cinder-quobyte-8f449de4-a764-4fbe-8add-48706f79684c" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:15:22 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a1801038-4ff5-4c27-b4af-1dcb305936ac tempest-TaggedBootDevicesTest-816810426 None] Lock "cinder-quobyte-8f449de4-a764-4fbe-8add-48706f79684c" acquired by "delete_volume" :: waited 0.078s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:15:22 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e120ce1c-a8cf-41c5-a85a-9c3fa913684a]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:15:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a1801038-4ff5-4c27-b4af-1dcb305936ac tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8f449de4-a764-4fbe-8add-48706f79684c {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:15:24 devstack quobyte-client[84065]: System call of process 88692 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:15:24 devstack quobyte-client[84065]: System call of process 88692 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:15:24 devstack quobyte-client[84065]: System call of process 88692 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:15:24 devstack quobyte-client[84065]: System call of process 88692 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:15:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a1801038-4ff5-4c27-b4af-1dcb305936ac tempest-TaggedBootDevicesTest-816810426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8f449de4-a764-4fbe-8add-48706f79684c" returned: 0 in 2.166s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:15:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a1801038-4ff5-4c27-b4af-1dcb305936ac tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8f449de4-a764-4fbe-8add-48706f79684c {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:15:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a1801038-4ff5-4c27-b4af-1dcb305936ac tempest-TaggedBootDevicesTest-816810426 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8f449de4-a764-4fbe-8add-48706f79684c" returned: 0 in 0.395s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:15:25 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a1801038-4ff5-4c27-b4af-1dcb305936ac tempest-TaggedBootDevicesTest-816810426 None] Lock "cinder-quobyte-8f449de4-a764-4fbe-8add-48706f79684c" released by "delete_volume" :: held 3.519s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:15:26 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-a1801038-4ff5-4c27-b4af-1dcb305936ac tempest-TaggedBootDevicesTest-816810426 None] Created reservations ['fa671be4-6a5e-4495-b74b-c16b34149092', '6c6adf51-fa01-43c9-8153-c38222ce1668', 'daaa0aa7-9a1c-4897-8f13-048f56f2407a', 'a551541f-e476-46e0-8a07-ce5529b1fc90'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:15:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a1801038-4ff5-4c27-b4af-1dcb305936ac tempest-TaggedBootDevicesTest-816810426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:15:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a1801038-4ff5-4c27-b4af-1dcb305936ac tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:15:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a1801038-4ff5-4c27-b4af-1dcb305936ac tempest-TaggedBootDevicesTest-816810426 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:15:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a1801038-4ff5-4c27-b4af-1dcb305936ac tempest-TaggedBootDevicesTest-816810426 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:15:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a1801038-4ff5-4c27-b4af-1dcb305936ac tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:15:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a1801038-4ff5-4c27-b4af-1dcb305936ac tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:15:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a1801038-4ff5-4c27-b4af-1dcb305936ac tempest-TaggedBootDevicesTest-816810426 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.369s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:15:27 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-a1801038-4ff5-4c27-b4af-1dcb305936ac tempest-TaggedBootDevicesTest-816810426 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:15:27 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-a1801038-4ff5-4c27-b4af-1dcb305936ac tempest-TaggedBootDevicesTest-816810426 None] Deleted volume successfully.
Sep 22 23:15:28 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] Acquiring lock "cinder-599eb48a-3c51-4f60-a512-a0e5f85ccda4-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:15:28 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] Lock "cinder-599eb48a-3c51-4f60-a512-a0e5f85ccda4-delete_volume" acquired by "delete_volume" :: waited 0.248s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:15:28 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a1801038-4ff5-4c27-b4af-1dcb305936ac tempest-TaggedBootDevicesTest-816810426 None] Lock "cinder-8f449de4-a764-4fbe-8add-48706f79684c-delete_volume" released by "delete_volume" :: held 7.597s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:15:28 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:15:28 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] Acquiring lock "cinder-quobyte-599eb48a-3c51-4f60-a512-a0e5f85ccda4" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:15:28 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] Lock "cinder-quobyte-599eb48a-3c51-4f60-a512-a0e5f85ccda4" acquired by "delete_volume" :: waited 0.025s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:15:29 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c3e006-68ae-4216-aa7f-66ec8c55a7aa]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:15:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:15:29 devstack quobyte-client[84065]: System call of process 88726 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:15:29 devstack quobyte-client[84065]: System call of process 88726 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:15:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4" returned: 0 in 0.697s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:15:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:15:31 devstack quobyte-client[84065]: System call of process 88728 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:15:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4" returned: 1 in 1.246s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:15:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:15:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:15:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-599eb48a-3c51-4f60-a512-a0e5f85ccda4" returned: 0 in 0.173s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:15:31 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] Lock "cinder-quobyte-599eb48a-3c51-4f60-a512-a0e5f85ccda4" released by "delete_volume" :: held 2.765s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:15:32 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] Created reservations ['e82e2e6a-92f0-4457-a41f-bdaaf2c735c2', '5dc3660c-b987-483e-8a90-e78776d3af7e', 'e5056fb5-0a43-4d8f-bfeb-495f3192ff14', 'b9dcb83a-a2b4-4f2b-81fc-06001eb5cd24'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:15:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:15:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:15:32 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:15:32 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:15:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:15:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:15:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.143s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:15:32 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:15:32 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] Deleted volume successfully.
Sep 22 23:15:33 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6c88b554-3d8d-42cd-b837-1f077181d3a4 tempest-TaggedBootDevicesTest-816810426 None] Lock "cinder-599eb48a-3c51-4f60-a512-a0e5f85ccda4-delete_volume" released by "delete_volume" :: held 4.806s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:15:42 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=17,cinder:UPDATE=41,cinder:INSERT=7,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:15:43 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=13,cinder:INSERT=5,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:15:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:15:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:15:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:15:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:15:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:15:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:15:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:15:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.168s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:15:47 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:15:58 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Flow 'volume_create_manager' (92a29157-5f23-4a38-bbe3-205d7fa9e461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e79ec65e-97f3-4d0c-a4e5-23ced36e878d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e79ec65e-97f3-4d0c-a4e5-23ced36e878d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-67900479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4597dc7-05fe-4385-aa90-e76bf9d6d77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842b72d51b654d3abae989d93b7eb427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:15:58Z,use_quota=True,user_id='a946c5f047a44373a647c0ca65e07277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e3333f0-8952-4f62-8ea4-c14496afeda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e3333f0-8952-4f62-8ea4-c14496afeda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec00d12b-6a01-44e5-9922-4452498a4348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec00d12b-6a01-44e5-9922-4452498a4348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4597dc7-05fe-4385-aa90-e76bf9d6d77c', 'volume_name': 'volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cdb1a49-7d74-43a8-8819-86945338da21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cdb1a49-7d74-43a8-8819-86945338da21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2707043d-1640-453f-a046-62dd810e787f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:15:58 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Volume d4597dc7-05fe-4385-aa90-e76bf9d6d77c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c', 'volume_size': 1}
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-67900479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4597dc7-05fe-4385-aa90-e76bf9d6d77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842b72d51b654d3abae989d93b7eb427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:15:58Z,use_quota=True,user_id='a946c5f047a44373a647c0ca65e07277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Creating volume d4597dc7-05fe-4385-aa90-e76bf9d6d77c {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:15:58 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:15:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:15:58 devstack quobyte-client[84065]: System call of process 88812 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:15:58 devstack quobyte-client[84065]: System call of process 88812 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:15:58 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=12, name=volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:15:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c 1073741824" returned: 0 in 0.484s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:15:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:15:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c" returned: 0 in 0.129s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:15:59 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] <== create_volume: return (733ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:15:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:15:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2707043d-1640-453f-a046-62dd810e787f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:15:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3d6f7c-6821-4aed-a8d2-d7e73e438406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:15:59 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Volume volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c (d4597dc7-05fe-4385-aa90-e76bf9d6d77c): created successfully
Sep 22 23:15:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3d6f7c-6821-4aed-a8d2-d7e73e438406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:15:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Flow 'volume_create_manager' (92a29157-5f23-4a38-bbe3-205d7fa9e461) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:15:59 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-c19be6c1-9236-45fa-b85a-83722a4ff557 req-f90b34c9-8be3-40a6-b269-505dc52655be tempest-VolumesSnapshotsTestJSON-787486636 None] Created volume successfully.
Sep 22 23:16:01 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:16:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:16:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:16:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] Creating offline snapshot db947fb2-2e08-4f1c-9653-13819927a6db of volume d4597dc7-05fe-4385-aa90-e76bf9d6d77c {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:16:01 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb4a5c6-0855-40af-81fd-65364fe5225c]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:16:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:01 devstack quobyte-client[84065]: System call of process 88818 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:01 devstack quobyte-client[84065]: System call of process 88818 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c" returned: 0 in 0.621s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.db947fb2-2e08-4f1c-9653-13819927a6db 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:02 devstack quobyte-client[84065]: System call of process 88822 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:02 devstack quobyte-client[84065]: System call of process 88822 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:02 devstack quobyte-client[84065]: System call of process 88822 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:02 devstack quobyte-client[84065]: System call of process 88822 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:02 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=13, name=volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.db947fb2-2e08-4f1c-9653-13819927a6db, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:16:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.db947fb2-2e08-4f1c-9653-13819927a6db 1G" returned: 0 in 0.322s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.db947fb2-2e08-4f1c-9653-13819927a6db {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:02 devstack quobyte-client[84065]: System call of process 88826 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] CMD "qemu-img rebase -u -b volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.db947fb2-2e08-4f1c-9653-13819927a6db" returned: 0 in 0.199s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:02 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.db947fb2-2e08-4f1c-9653-13819927a6db is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:16:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.db947fb2-2e08-4f1c-9653-13819927a6db {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.db947fb2-2e08-4f1c-9653-13819927a6db" returned: 0 in 0.120s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:02 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:16:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.db947fb2-2e08-4f1c-9653-13819927a6db {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.db947fb2-2e08-4f1c-9653-13819927a6db" returned: 0 in 0.137s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:03 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.info" returned: 0 in 0.130s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:03 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.info is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:16:03 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:03 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.info" returned: 0 in 0.142s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:03 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.158s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:16:03 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-b78bc9e3-5301-4454-994b-7005b851ceac req-46c70ecd-2c83-4f29-8833-20807cb1cc05 tempest-VolumesSnapshotsTestJSON-787486636 None] Create snapshot completed successfully
Sep 22 23:16:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] Acquiring lock "cinder-db947fb2-2e08-4f1c-9653-13819927a6db-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:16:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] Lock "cinder-db947fb2-2e08-4f1c-9653-13819927a6db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.087s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:16:04 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:16:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] Acquiring lock "cinder-quobyte-d4597dc7-05fe-4385-aa90-e76bf9d6d77c" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:16:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] Lock "cinder-quobyte-d4597dc7-05fe-4385-aa90-e76bf9d6d77c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:16:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] Acquiring lock "cinder-quobyte-db947fb2-2e08-4f1c-9653-13819927a6db" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:16:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] Lock "cinder-quobyte-db947fb2-2e08-4f1c-9653-13819927a6db" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:16:04 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] Deleting offline snapshot db947fb2-2e08-4f1c-9653-13819927a6db of volume d4597dc7-05fe-4385-aa90-e76bf9d6d77c {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:16:04 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] snapshot_file for this snap is: volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.db947fb2-2e08-4f1c-9653-13819927a6db {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:16:04 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58c082f-b42b-4fd0-98d5-427b1536897e]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:16:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.db947fb2-2e08-4f1c-9653-13819927a6db {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:05 devstack quobyte-client[84065]: System call of process 88859 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:05 devstack quobyte-client[84065]: System call of process 88859 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.db947fb2-2e08-4f1c-9653-13819927a6db" returned: 0 in 0.464s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:16:05 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fef0f8-9075-43ba-ab8b-1b49a995e2a8]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:16:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:06 devstack quobyte-client[84065]: System call of process 88862 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c" returned: 0 in 0.682s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.db947fb2-2e08-4f1c-9653-13819927a6db {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:06 devstack quobyte-client[84065]: System call of process 88865 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:06 devstack quobyte-client[84065]: System call of process 88865 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.db947fb2-2e08-4f1c-9653-13819927a6db" returned: 0 in 0.308s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.db947fb2-2e08-4f1c-9653-13819927a6db {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c.db947fb2-2e08-4f1c-9653-13819927a6db" returned: 0 in 0.149s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] Lock "cinder-quobyte-db947fb2-2e08-4f1c-9653-13819927a6db" released by "_delete_snapshot" :: held 2.012s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:16:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] Lock "cinder-quobyte-d4597dc7-05fe-4385-aa90-e76bf9d6d77c" released by "delete_snapshot" :: held 2.048s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:16:07 devstack cinder-volume[84012]: WARNING cinder.quota [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:16:07 devstack cinder-volume[84012]: DEBUG cinder.quota [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] Created reservations ['f903d6db-907e-4261-9394-97c39a18941b', '9fcb1650-6690-49be-a853-4c33b4177519', '5243a7bc-e80d-4664-902d-240de4953794', 'b533640e-9dbf-4c12-86b8-5a6cda207f39'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:16:07 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] Delete snapshot completed successfully.
Sep 22 23:16:07 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-0cf4d805-1f49-41ca-9db7-58dcc3959cd0 req-512f440b-6cdb-42ff-94b4-ce8d35200f88 tempest-VolumesSnapshotsTestJSON-787486636 None] Lock "cinder-db947fb2-2e08-4f1c-9653-13819927a6db-delete_snapshot" released by "delete_snapshot" :: held 2.653s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:16:08 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-f591cbda-f8d3-40ba-b2a0-e46c14188418 req-6a70efbe-bca6-4e06-94ab-2aa621fa94c3 tempest-VolumesSnapshotsTestJSON-787486636 None] Acquiring lock "cinder-d4597dc7-05fe-4385-aa90-e76bf9d6d77c-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:16:08 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-f591cbda-f8d3-40ba-b2a0-e46c14188418 req-6a70efbe-bca6-4e06-94ab-2aa621fa94c3 tempest-VolumesSnapshotsTestJSON-787486636 None] Lock "cinder-d4597dc7-05fe-4385-aa90-e76bf9d6d77c-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:16:08 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-f591cbda-f8d3-40ba-b2a0-e46c14188418 req-6a70efbe-bca6-4e06-94ab-2aa621fa94c3 tempest-VolumesSnapshotsTestJSON-787486636 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:16:08 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-f591cbda-f8d3-40ba-b2a0-e46c14188418 req-6a70efbe-bca6-4e06-94ab-2aa621fa94c3 tempest-VolumesSnapshotsTestJSON-787486636 None] Acquiring lock "cinder-quobyte-d4597dc7-05fe-4385-aa90-e76bf9d6d77c" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:16:08 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-f591cbda-f8d3-40ba-b2a0-e46c14188418 req-6a70efbe-bca6-4e06-94ab-2aa621fa94c3 tempest-VolumesSnapshotsTestJSON-787486636 None] Lock "cinder-quobyte-d4597dc7-05fe-4385-aa90-e76bf9d6d77c" acquired by "delete_volume" :: waited 0.044s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:16:08 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7beb53b4-41a7-4476-bcc4-00e61f5d78ed]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:16:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-f591cbda-f8d3-40ba-b2a0-e46c14188418 req-6a70efbe-bca6-4e06-94ab-2aa621fa94c3 tempest-VolumesSnapshotsTestJSON-787486636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-f591cbda-f8d3-40ba-b2a0-e46c14188418 req-6a70efbe-bca6-4e06-94ab-2aa621fa94c3 tempest-VolumesSnapshotsTestJSON-787486636 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c" returned: 0 in 0.581s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-f591cbda-f8d3-40ba-b2a0-e46c14188418 req-6a70efbe-bca6-4e06-94ab-2aa621fa94c3 tempest-VolumesSnapshotsTestJSON-787486636 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-f591cbda-f8d3-40ba-b2a0-e46c14188418 req-6a70efbe-bca6-4e06-94ab-2aa621fa94c3 tempest-VolumesSnapshotsTestJSON-787486636 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d4597dc7-05fe-4385-aa90-e76bf9d6d77c" returned: 0 in 0.273s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:10 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-f591cbda-f8d3-40ba-b2a0-e46c14188418 req-6a70efbe-bca6-4e06-94ab-2aa621fa94c3 tempest-VolumesSnapshotsTestJSON-787486636 None] Lock "cinder-quobyte-d4597dc7-05fe-4385-aa90-e76bf9d6d77c" released by "delete_volume" :: held 1.301s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:16:10 devstack cinder-volume[84012]: DEBUG cinder.quota [req-f591cbda-f8d3-40ba-b2a0-e46c14188418 req-6a70efbe-bca6-4e06-94ab-2aa621fa94c3 tempest-VolumesSnapshotsTestJSON-787486636 None] Created reservations ['dabf60dc-fda1-46b7-a0c6-40bac5831ff2', 'd6f7f562-8090-43f7-8209-067d37dfc5f3', '635730b1-2da9-41cb-857a-cf8d476c6643', 'eaa1fd92-9eb1-4d1e-af00-4041a41bec0e'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:16:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-f591cbda-f8d3-40ba-b2a0-e46c14188418 req-6a70efbe-bca6-4e06-94ab-2aa621fa94c3 tempest-VolumesSnapshotsTestJSON-787486636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:16:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-f591cbda-f8d3-40ba-b2a0-e46c14188418 req-6a70efbe-bca6-4e06-94ab-2aa621fa94c3 tempest-VolumesSnapshotsTestJSON-787486636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:16:10 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [req-f591cbda-f8d3-40ba-b2a0-e46c14188418 req-6a70efbe-bca6-4e06-94ab-2aa621fa94c3 tempest-VolumesSnapshotsTestJSON-787486636 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:16:10 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [req-f591cbda-f8d3-40ba-b2a0-e46c14188418 req-6a70efbe-bca6-4e06-94ab-2aa621fa94c3 tempest-VolumesSnapshotsTestJSON-787486636 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:16:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-f591cbda-f8d3-40ba-b2a0-e46c14188418 req-6a70efbe-bca6-4e06-94ab-2aa621fa94c3 tempest-VolumesSnapshotsTestJSON-787486636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:16:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-f591cbda-f8d3-40ba-b2a0-e46c14188418 req-6a70efbe-bca6-4e06-94ab-2aa621fa94c3 tempest-VolumesSnapshotsTestJSON-787486636 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-f591cbda-f8d3-40ba-b2a0-e46c14188418 req-6a70efbe-bca6-4e06-94ab-2aa621fa94c3 tempest-VolumesSnapshotsTestJSON-787486636 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.157s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:10 devstack cinder-volume[84012]: DEBUG cinder.manager [req-f591cbda-f8d3-40ba-b2a0-e46c14188418 req-6a70efbe-bca6-4e06-94ab-2aa621fa94c3 tempest-VolumesSnapshotsTestJSON-787486636 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:16:10 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-f591cbda-f8d3-40ba-b2a0-e46c14188418 req-6a70efbe-bca6-4e06-94ab-2aa621fa94c3 tempest-VolumesSnapshotsTestJSON-787486636 None] Deleted volume successfully.
Sep 22 23:16:11 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-f591cbda-f8d3-40ba-b2a0-e46c14188418 req-6a70efbe-bca6-4e06-94ab-2aa621fa94c3 tempest-VolumesSnapshotsTestJSON-787486636 None] Lock "cinder-d4597dc7-05fe-4385-aa90-e76bf9d6d77c-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:16:13 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Flow 'volume_create_manager' (0cd7eed1-834e-48b3-82c6-477385e0892a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a688edf5-7b86-4011-9161-e917b90241d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a688edf5-7b86-4011-9161-e917b90241d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-893666007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620cd253-8697-4dc5-acbf-a6db48d27e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f68ad47e2234dc6a4a1d26431b3ade3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:16:13Z,use_quota=True,user_id='66f61eabde72447084620e13cb3fa1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692e3e9a-6a43-43bc-9227-66fc01f339e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692e3e9a-6a43-43bc-9227-66fc01f339e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf741bf-0924-48f9-b525-552b411bbbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf741bf-0924-48f9-b525-552b411bbbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '620cd253-8697-4dc5-acbf-a6db48d27e29', 'volume_name': 'volume-620cd253-8697-4dc5-acbf-a6db48d27e29', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5970071-241b-4435-b94a-a90bf59d66c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5970071-241b-4435-b94a-a90bf59d66c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4c00c3-a813-44dd-ae9f-e8b0b67638ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:13 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Volume 620cd253-8697-4dc5-acbf-a6db48d27e29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-620cd253-8697-4dc5-acbf-a6db48d27e29', 'volume_size': 1}
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-893666007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620cd253-8697-4dc5-acbf-a6db48d27e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f68ad47e2234dc6a4a1d26431b3ade3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:16:13Z,use_quota=True,user_id='66f61eabde72447084620e13cb3fa1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Creating volume 620cd253-8697-4dc5-acbf-a6db48d27e29 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:16:13 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:16:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-620cd253-8697-4dc5-acbf-a6db48d27e29 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:13 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=15, name=volume-620cd253-8697-4dc5-acbf-a6db48d27e29, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:16:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-620cd253-8697-4dc5-acbf-a6db48d27e29 1073741824" returned: 0 in 1.014s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-620cd253-8697-4dc5-acbf-a6db48d27e29 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-620cd253-8697-4dc5-acbf-a6db48d27e29" returned: 0 in 0.306s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:15 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] <== create_volume: return (1458ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:16:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:16:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4c00c3-a813-44dd-ae9f-e8b0b67638ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-620cd253-8697-4dc5-acbf-a6db48d27e29', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69167d7d-e44e-4156-8cb8-ce9cd43fdfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:15 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Volume volume-620cd253-8697-4dc5-acbf-a6db48d27e29 (620cd253-8697-4dc5-acbf-a6db48d27e29): created successfully
Sep 22 23:16:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69167d7d-e44e-4156-8cb8-ce9cd43fdfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Flow 'volume_create_manager' (0cd7eed1-834e-48b3-82c6-477385e0892a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:16:15 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-dde65d20-bda4-44de-b27c-0c1db537be5d tempest-AttachVolumeShelveTestJSON-1091243525 None] Created volume successfully.
Sep 22 23:16:18 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Flow 'volume_create_manager' (b4ec3526-8278-440f-bc77-2893e09bafbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623571fe-bbe1-45e9-beb2-dfd24c54b70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623571fe-bbe1-45e9-beb2-dfd24c54b70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-493624077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='40cc84fe0d284b44b8bc74c73c1df37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:16:19Z,use_quota=True,user_id='790a9a31c50a4673a4c921b5af2d49e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ba605b-a171-4ed0-9621-609be6e76d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ba605b-a171-4ed0-9621-609be6e76d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f246430b-7c85-4e76-8e08-884c96283501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f246430b-7c85-4e76-8e08-884c96283501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e', 'volume_name': 'volume-1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f959a89e-bfaf-48e9-9da0-a1a7c1897b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f959a89e-bfaf-48e9-9da0-a1a7c1897b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93684d6e-cef9-49b2-aeb8-16b0575e4703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:18 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Volume 1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e', 'volume_size': 1}
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-493624077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='40cc84fe0d284b44b8bc74c73c1df37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:16:19Z,use_quota=True,user_id='790a9a31c50a4673a4c921b5af2d49e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Creating volume 1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:16:18 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:16:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:19 devstack quobyte-client[84065]: System call of process 88931 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:19 devstack quobyte-client[84065]: System call of process 88931 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:19 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=16, name=volume-1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:16:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e 1073741824" returned: 0 in 0.469s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e" returned: 0 in 0.150s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:19 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] <== create_volume: return (724ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:16:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:16:19 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93684d6e-cef9-49b2-aeb8-16b0575e4703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:19 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba97a8b0-5033-4f51-a579-60d3e83f853a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:19 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Volume volume-1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e (1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e): created successfully
Sep 22 23:16:19 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba97a8b0-5033-4f51-a579-60d3e83f853a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:19 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Flow 'volume_create_manager' (b4ec3526-8278-440f-bc77-2893e09bafbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:16:20 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-c151d021-cd43-43cb-bc5c-923c641694aa req-284dfe14-a8dc-4ab5-9d90-8a263c26460d tempest-VolumesGetTestJSON-595066321 None] Created volume successfully.
Sep 22 23:16:21 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-556b745e-d1ae-4da5-a8c9-ba02886c5513 req-ad968c22-cb9b-411f-bfae-c82cd0fb4cbb tempest-VolumesGetTestJSON-595066321 None] Acquiring lock "cinder-1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:16:21 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-556b745e-d1ae-4da5-a8c9-ba02886c5513 req-ad968c22-cb9b-411f-bfae-c82cd0fb4cbb tempest-VolumesGetTestJSON-595066321 None] Lock "cinder-1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:16:21 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-556b745e-d1ae-4da5-a8c9-ba02886c5513 req-ad968c22-cb9b-411f-bfae-c82cd0fb4cbb tempest-VolumesGetTestJSON-595066321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:16:21 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-556b745e-d1ae-4da5-a8c9-ba02886c5513 req-ad968c22-cb9b-411f-bfae-c82cd0fb4cbb tempest-VolumesGetTestJSON-595066321 None] Acquiring lock "cinder-quobyte-1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:16:21 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-556b745e-d1ae-4da5-a8c9-ba02886c5513 req-ad968c22-cb9b-411f-bfae-c82cd0fb4cbb tempest-VolumesGetTestJSON-595066321 None] Lock "cinder-quobyte-1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e" acquired by "delete_volume" :: waited 0.065s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:16:21 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[040cebe2-4dde-4c1a-8f67-b3d316ba136e]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:16:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-556b745e-d1ae-4da5-a8c9-ba02886c5513 req-ad968c22-cb9b-411f-bfae-c82cd0fb4cbb tempest-VolumesGetTestJSON-595066321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:23 devstack quobyte-client[84065]: System call of process 88956 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:23 devstack quobyte-client[84065]: System call of process 88956 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:23 devstack quobyte-client[84065]: System call of process 88956 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-556b745e-d1ae-4da5-a8c9-ba02886c5513 req-ad968c22-cb9b-411f-bfae-c82cd0fb4cbb tempest-VolumesGetTestJSON-595066321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e" returned: 0 in 1.870s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-556b745e-d1ae-4da5-a8c9-ba02886c5513 req-ad968c22-cb9b-411f-bfae-c82cd0fb4cbb tempest-VolumesGetTestJSON-595066321 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-556b745e-d1ae-4da5-a8c9-ba02886c5513 req-ad968c22-cb9b-411f-bfae-c82cd0fb4cbb tempest-VolumesGetTestJSON-595066321 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e" returned: 0 in 0.551s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:24 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-556b745e-d1ae-4da5-a8c9-ba02886c5513 req-ad968c22-cb9b-411f-bfae-c82cd0fb4cbb tempest-VolumesGetTestJSON-595066321 None] Lock "cinder-quobyte-1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e" released by "delete_volume" :: held 3.168s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:16:25 devstack cinder-volume[84012]: DEBUG cinder.quota [req-556b745e-d1ae-4da5-a8c9-ba02886c5513 req-ad968c22-cb9b-411f-bfae-c82cd0fb4cbb tempest-VolumesGetTestJSON-595066321 None] Created reservations ['9341faac-3329-4f6a-9be7-cf8c46621b59', '0de17d97-d407-4aa5-8f9c-3a140390a788', '2372bfb7-d5ba-4476-99b7-7602934b61f0', '51151876-72ce-4650-8497-6eb1f49cc3b7'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:16:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-556b745e-d1ae-4da5-a8c9-ba02886c5513 req-ad968c22-cb9b-411f-bfae-c82cd0fb4cbb tempest-VolumesGetTestJSON-595066321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:16:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-556b745e-d1ae-4da5-a8c9-ba02886c5513 req-ad968c22-cb9b-411f-bfae-c82cd0fb4cbb tempest-VolumesGetTestJSON-595066321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:16:26 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [req-556b745e-d1ae-4da5-a8c9-ba02886c5513 req-ad968c22-cb9b-411f-bfae-c82cd0fb4cbb tempest-VolumesGetTestJSON-595066321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:16:26 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [req-556b745e-d1ae-4da5-a8c9-ba02886c5513 req-ad968c22-cb9b-411f-bfae-c82cd0fb4cbb tempest-VolumesGetTestJSON-595066321 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:16:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-556b745e-d1ae-4da5-a8c9-ba02886c5513 req-ad968c22-cb9b-411f-bfae-c82cd0fb4cbb tempest-VolumesGetTestJSON-595066321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:16:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-556b745e-d1ae-4da5-a8c9-ba02886c5513 req-ad968c22-cb9b-411f-bfae-c82cd0fb4cbb tempest-VolumesGetTestJSON-595066321 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-556b745e-d1ae-4da5-a8c9-ba02886c5513 req-ad968c22-cb9b-411f-bfae-c82cd0fb4cbb tempest-VolumesGetTestJSON-595066321 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.236s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:26 devstack cinder-volume[84012]: DEBUG cinder.manager [req-556b745e-d1ae-4da5-a8c9-ba02886c5513 req-ad968c22-cb9b-411f-bfae-c82cd0fb4cbb tempest-VolumesGetTestJSON-595066321 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:16:27 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-556b745e-d1ae-4da5-a8c9-ba02886c5513 req-ad968c22-cb9b-411f-bfae-c82cd0fb4cbb tempest-VolumesGetTestJSON-595066321 None] Deleted volume successfully.
Sep 22 23:16:27 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-556b745e-d1ae-4da5-a8c9-ba02886c5513 req-ad968c22-cb9b-411f-bfae-c82cd0fb4cbb tempest-VolumesGetTestJSON-595066321 None] Lock "cinder-1ffd0f09-e2d1-44ca-ad6e-9642c2a6d91e-delete_volume" released by "delete_volume" :: held 6.301s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:16:33 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Flow 'volume_create_manager' (c1aded2a-e6f4-4567-92a8-d9b7fcf93939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c337a71a-c00f-4041-9d77-0f1e162a3264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c337a71a-c00f-4041-9d77-0f1e162a3264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1165535547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e5469a-1592-4f03-9a77-5119c6f1c481,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5f0d5927c4bf4104bf2ff4e922321f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:16:33Z,use_quota=True,user_id='70ad8f603ff24a1197171c38351661c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631f276b-b102-486e-a5dc-a09ffc45c961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631f276b-b102-486e-a5dc-a09ffc45c961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09c2c27-3c0c-4dd3-8dfb-944e94e3b954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09c2c27-3c0c-4dd3-8dfb-944e94e3b954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9e5469a-1592-4f03-9a77-5119c6f1c481', 'volume_name': 'volume-f9e5469a-1592-4f03-9a77-5119c6f1c481', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3fe2b7-8eb1-4bfc-b311-f656e1a16144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3fe2b7-8eb1-4bfc-b311-f656e1a16144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95f5b15-0e12-4c37-858b-b0d96ecda084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:33 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Volume f9e5469a-1592-4f03-9a77-5119c6f1c481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9e5469a-1592-4f03-9a77-5119c6f1c481', 'volume_size': 1}
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1165535547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e5469a-1592-4f03-9a77-5119c6f1c481,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5f0d5927c4bf4104bf2ff4e922321f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:16:33Z,use_quota=True,user_id='70ad8f603ff24a1197171c38351661c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Creating volume f9e5469a-1592-4f03-9a77-5119c6f1c481 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:16:33 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:16:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f9e5469a-1592-4f03-9a77-5119c6f1c481 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:33 devstack quobyte-client[84065]: System call of process 89072 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:33 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=17, name=volume-f9e5469a-1592-4f03-9a77-5119c6f1c481, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:16:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f9e5469a-1592-4f03-9a77-5119c6f1c481 1073741824" returned: 0 in 0.457s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f9e5469a-1592-4f03-9a77-5119c6f1c481 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f9e5469a-1592-4f03-9a77-5119c6f1c481" returned: 0 in 0.157s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:34 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] <== create_volume: return (684ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:16:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:16:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95f5b15-0e12-4c37-858b-b0d96ecda084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9e5469a-1592-4f03-9a77-5119c6f1c481', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d58eb1d-b60a-4d55-a5e6-8e0616fc065f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:34 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Volume volume-f9e5469a-1592-4f03-9a77-5119c6f1c481 (f9e5469a-1592-4f03-9a77-5119c6f1c481): created successfully
Sep 22 23:16:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d58eb1d-b60a-4d55-a5e6-8e0616fc065f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Flow 'volume_create_manager' (c1aded2a-e6f4-4567-92a8-d9b7fcf93939) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:16:34 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-d88f2857-9297-41ef-9012-346a9029b07a tempest-VolumesTestJSON-454221321 None] Created volume successfully.
Sep 22 23:16:36 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Flow 'volume_create_manager' (88bf36ad-9657-4481-b153-e4f6ccc8115b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426ef685-b8da-44c5-9e7d-e88be79ef562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426ef685-b8da-44c5-9e7d-e88be79ef562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1375773639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5f0d5927c4bf4104bf2ff4e922321f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:16:36Z,use_quota=True,user_id='70ad8f603ff24a1197171c38351661c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f57f8e81-f2fa-4b89-b2c7-cda514771f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f57f8e81-f2fa-4b89-b2c7-cda514771f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865feace-f215-4286-a1fe-477d6a4b0537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865feace-f215-4286-a1fe-477d6a4b0537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca', 'volume_name': 'volume-0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf963bf2-22ef-428f-ae00-06e004d892c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf963bf2-22ef-428f-ae00-06e004d892c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90714782-c348-4026-a937-7c262e28db35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:36 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Volume 0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca', 'volume_size': 1}
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1375773639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5f0d5927c4bf4104bf2ff4e922321f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:16:36Z,use_quota=True,user_id='70ad8f603ff24a1197171c38351661c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Creating volume 0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:16:36 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:16:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:36 devstack quobyte-client[84065]: System call of process 89076 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:36 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=18, name=volume-0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:16:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca 1073741824" returned: 0 in 0.464s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca" returned: 0 in 0.136s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] <== create_volume: return (666ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:16:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:16:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90714782-c348-4026-a937-7c262e28db35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b2fefa-141f-4f3e-827f-f33b837ad41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:37 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Volume volume-0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca (0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca): created successfully
Sep 22 23:16:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b2fefa-141f-4f3e-827f-f33b837ad41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Flow 'volume_create_manager' (88bf36ad-9657-4481-b153-e4f6ccc8115b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:16:37 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-c8b2d938-60b6-4b0d-8980-f6fd6573c409 tempest-VolumesTestJSON-454221321 None] Created volume successfully.
Sep 22 23:16:40 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Flow 'volume_create_manager' (2679b782-dba5-45d7-8384-acf910c58817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e58d1e-9ad9-4d24-9dad-486cc7434e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e58d1e-9ad9-4d24-9dad-486cc7434e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2129780753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73b74c7-df61-4edf-97fb-262ed53af302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838892ace8b2480cb449321c05f51da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:16:40Z,use_quota=True,user_id='8fd961a280d94838b29811c87cfc65b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ef0cd1-35a0-4e7d-9184-f70cda18c2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ef0cd1-35a0-4e7d-9184-f70cda18c2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5330e69-f255-45dd-b658-e04dc4458179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5330e69-f255-45dd-b658-e04dc4458179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c73b74c7-df61-4edf-97fb-262ed53af302', 'volume_name': 'volume-c73b74c7-df61-4edf-97fb-262ed53af302', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e2d0c4-9f7e-45b4-911b-b8f06d24b57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e2d0c4-9f7e-45b4-911b-b8f06d24b57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c212668-05e6-40f2-93ac-c5fb4231436d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:40 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Volume c73b74c7-df61-4edf-97fb-262ed53af302: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c73b74c7-df61-4edf-97fb-262ed53af302', 'volume_size': 1}
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2129780753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73b74c7-df61-4edf-97fb-262ed53af302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838892ace8b2480cb449321c05f51da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:16:40Z,use_quota=True,user_id='8fd961a280d94838b29811c87cfc65b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Creating volume c73b74c7-df61-4edf-97fb-262ed53af302 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:16:40 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:16:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c73b74c7-df61-4edf-97fb-262ed53af302 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:40 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=19, name=volume-c73b74c7-df61-4edf-97fb-262ed53af302, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:16:40 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Flow 'volume_create_manager' (2d47bbcf-827b-4b28-bbc2-3acff57f7093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132a467c-9adf-4d85-afe1-faa1265afbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c73b74c7-df61-4edf-97fb-262ed53af302 1073741824" returned: 0 in 0.853s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c73b74c7-df61-4edf-97fb-262ed53af302 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132a467c-9adf-4d85-afe1-faa1265afbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-118070922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5f0d5927c4bf4104bf2ff4e922321f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:16:40Z,use_quota=True,user_id='70ad8f603ff24a1197171c38351661c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5ab044-1998-4d31-8ca2-72aad3bd91ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5ab044-1998-4d31-8ca2-72aad3bd91ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd374d5d-b434-4e4a-999e-7a5869bbff9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd374d5d-b434-4e4a-999e-7a5869bbff9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4', 'volume_name': 'volume-e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e42d56d-d80d-43e4-82fa-d88c8e52dfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e42d56d-d80d-43e4-82fa-d88c8e52dfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7690afe0-50dd-47ff-8807-8d8633869de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:41 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Volume e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4', 'volume_size': 1}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c73b74c7-df61-4edf-97fb-262ed53af302" returned: 0 in 0.370s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] <== create_volume: return (1244ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.114s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-118070922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5f0d5927c4bf4104bf2ff4e922321f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:16:40Z,use_quota=True,user_id='70ad8f603ff24a1197171c38351661c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Creating volume e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:16:41 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:16:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:42 devstack quobyte-client[84065]: System call of process 89103 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:42 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=20, name=volume-e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:16:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c212668-05e6-40f2-93ac-c5fb4231436d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c73b74c7-df61-4edf-97fb-262ed53af302', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78768ef5-da53-4a10-b924-40dbb9bd6a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4 1073741824" returned: 0 in 0.656s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:42 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Volume volume-c73b74c7-df61-4edf-97fb-262ed53af302 (c73b74c7-df61-4edf-97fb-262ed53af302): created successfully
Sep 22 23:16:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78768ef5-da53-4a10-b924-40dbb9bd6a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Flow 'volume_create_manager' (2679b782-dba5-45d7-8384-acf910c58817) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:16:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4" returned: 0 in 0.338s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] <== create_volume: return (1039ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:16:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:16:42 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-040ccec1-b9af-444b-ba4e-559cef955430 tempest-AttachVolumeNegativeTest-394912296 None] Created volume successfully.
Sep 22 23:16:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7690afe0-50dd-47ff-8807-8d8633869de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86c63df-9538-4ccb-bff7-911e5c0426dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:16:43 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Volume volume-e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4 (e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4): created successfully
Sep 22 23:16:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86c63df-9538-4ccb-bff7-911e5c0426dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:16:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Flow 'volume_create_manager' (2d47bbcf-827b-4b28-bbc2-3acff57f7093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:16:43 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-4cfa10bd-9ef1-42cc-ac17-a78a424e46b1 tempest-VolumesTestJSON-454221321 None] Created volume successfully.
Sep 22 23:16:45 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d33dd16c-5875-4a92-aa23-8861d3a36918 tempest-VolumesTestJSON-454221321 None] Acquiring lock "cinder-e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:16:45 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d33dd16c-5875-4a92-aa23-8861d3a36918 tempest-VolumesTestJSON-454221321 None] Lock "cinder-e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:16:45 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-d33dd16c-5875-4a92-aa23-8861d3a36918 tempest-VolumesTestJSON-454221321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:16:45 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d33dd16c-5875-4a92-aa23-8861d3a36918 tempest-VolumesTestJSON-454221321 None] Acquiring lock "cinder-quobyte-e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:16:45 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d33dd16c-5875-4a92-aa23-8861d3a36918 tempest-VolumesTestJSON-454221321 None] Lock "cinder-quobyte-e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4" acquired by "delete_volume" :: waited 0.029s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:16:45 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab1e8c2-2c61-4327-b691-fc70d8019db4]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:16:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d33dd16c-5875-4a92-aa23-8861d3a36918 tempest-VolumesTestJSON-454221321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:46 devstack quobyte-client[84065]: System call of process 89108 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:46 devstack quobyte-client[84065]: System call of process 89108 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d33dd16c-5875-4a92-aa23-8861d3a36918 tempest-VolumesTestJSON-454221321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4" returned: 0 in 0.902s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d33dd16c-5875-4a92-aa23-8861d3a36918 tempest-VolumesTestJSON-454221321 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d33dd16c-5875-4a92-aa23-8861d3a36918 tempest-VolumesTestJSON-454221321 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4" returned: 0 in 0.156s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:47 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d33dd16c-5875-4a92-aa23-8861d3a36918 tempest-VolumesTestJSON-454221321 None] Lock "cinder-quobyte-e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4" released by "delete_volume" :: held 1.360s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:16:47 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-d33dd16c-5875-4a92-aa23-8861d3a36918 tempest-VolumesTestJSON-454221321 None] Created reservations ['d224e6fa-26fa-4d91-9495-08dd39c0b767', '62406a49-6873-4bd5-93d3-d1592fe09a99', 'ef9faa7c-1ef7-4361-98b7-dd16d61018df', 'e90ab2b4-d9d3-4a14-bc59-663fc9d84bf9'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:16:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:16:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:16:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:16:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:16:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:16:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:16:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.457s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:16:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d33dd16c-5875-4a92-aa23-8861d3a36918 tempest-VolumesTestJSON-454221321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:16:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d33dd16c-5875-4a92-aa23-8861d3a36918 tempest-VolumesTestJSON-454221321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:16:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d33dd16c-5875-4a92-aa23-8861d3a36918 tempest-VolumesTestJSON-454221321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:16:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d33dd16c-5875-4a92-aa23-8861d3a36918 tempest-VolumesTestJSON-454221321 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:16:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d33dd16c-5875-4a92-aa23-8861d3a36918 tempest-VolumesTestJSON-454221321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:16:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d33dd16c-5875-4a92-aa23-8861d3a36918 tempest-VolumesTestJSON-454221321 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-2442efb2-acaa-4f2a-b094-b70daa17acea req-90ab3121-37f5-4d17-9e23-3a3a696bac4c tempest-AttachVolumeNegativeTest-394912296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:16:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-2442efb2-acaa-4f2a-b094-b70daa17acea req-90ab3121-37f5-4d17-9e23-3a3a696bac4c tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.018s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:16:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d33dd16c-5875-4a92-aa23-8861d3a36918 tempest-VolumesTestJSON-454221321 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.289s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-d33dd16c-5875-4a92-aa23-8861d3a36918 tempest-VolumesTestJSON-454221321 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:16:48 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-d33dd16c-5875-4a92-aa23-8861d3a36918 tempest-VolumesTestJSON-454221321 None] Deleted volume successfully.
Sep 22 23:16:48 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf8ab80-b8e7-4ad9-955d-adaf757bcb26]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:16:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-2442efb2-acaa-4f2a-b094-b70daa17acea req-90ab3121-37f5-4d17-9e23-3a3a696bac4c tempest-AttachVolumeNegativeTest-394912296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c73b74c7-df61-4edf-97fb-262ed53af302 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:49 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d33dd16c-5875-4a92-aa23-8861d3a36918 tempest-VolumesTestJSON-454221321 None] Lock "cinder-e9d3c2af-e8c8-42f2-a431-3ce21cffd1c4-delete_volume" released by "delete_volume" :: held 3.432s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:16:49 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d9f5782c-5e98-4666-98d2-6df8af85ea08 tempest-VolumesTestJSON-454221321 None] Acquiring lock "cinder-0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:16:49 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d9f5782c-5e98-4666-98d2-6df8af85ea08 tempest-VolumesTestJSON-454221321 None] Lock "cinder-0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:16:49 devstack quobyte-client[84065]: System call of process 89123 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-2442efb2-acaa-4f2a-b094-b70daa17acea req-90ab3121-37f5-4d17-9e23-3a3a696bac4c tempest-AttachVolumeNegativeTest-394912296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c73b74c7-df61-4edf-97fb-262ed53af302" returned: 0 in 0.695s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-2442efb2-acaa-4f2a-b094-b70daa17acea req-90ab3121-37f5-4d17-9e23-3a3a696bac4c tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.854s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:16:49 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-d9f5782c-5e98-4666-98d2-6df8af85ea08 tempest-VolumesTestJSON-454221321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:16:49 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d9f5782c-5e98-4666-98d2-6df8af85ea08 tempest-VolumesTestJSON-454221321 None] Acquiring lock "cinder-quobyte-0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:16:49 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d9f5782c-5e98-4666-98d2-6df8af85ea08 tempest-VolumesTestJSON-454221321 None] Lock "cinder-quobyte-0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca" acquired by "delete_volume" :: waited 0.018s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:16:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-2442efb2-acaa-4f2a-b094-b70daa17acea req-90ab3121-37f5-4d17-9e23-3a3a696bac4c tempest-AttachVolumeNegativeTest-394912296 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-c73b74c7-df61-4edf-97fb-262ed53af302', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2adb418-afbd-467e-860f-1d7614696262', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:16:49 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-2442efb2-acaa-4f2a-b094-b70daa17acea req-90ab3121-37f5-4d17-9e23-3a3a696bac4c tempest-AttachVolumeNegativeTest-394912296 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:16:49 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08240e3-2b5c-44cd-baeb-6a126d011ea2]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:16:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d9f5782c-5e98-4666-98d2-6df8af85ea08 tempest-VolumesTestJSON-454221321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:50 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-2442efb2-acaa-4f2a-b094-b70daa17acea req-90ab3121-37f5-4d17-9e23-3a3a696bac4c tempest-AttachVolumeNegativeTest-394912296 None] attachment_update completed successfully.
Sep 22 23:16:50 devstack quobyte-client[84065]: System call of process 89133 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d9f5782c-5e98-4666-98d2-6df8af85ea08 tempest-VolumesTestJSON-454221321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca" returned: 0 in 0.874s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d9f5782c-5e98-4666-98d2-6df8af85ea08 tempest-VolumesTestJSON-454221321 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-d81c44bf-21f3-4a79-ad5c-534eba2453f2 req-71c20dab-027d-4e76-ad22-9da97a9dc598 tempest-AttachVolumeShelveTestJSON-1091243525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:16:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-d81c44bf-21f3-4a79-ad5c-534eba2453f2 req-71c20dab-027d-4e76-ad22-9da97a9dc598 tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:16:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d9f5782c-5e98-4666-98d2-6df8af85ea08 tempest-VolumesTestJSON-454221321 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca" returned: 0 in 0.333s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:50 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9132d18-c25d-43b4-9d7d-d9a140449ba4]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:16:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-d81c44bf-21f3-4a79-ad5c-534eba2453f2 req-71c20dab-027d-4e76-ad22-9da97a9dc598 tempest-AttachVolumeShelveTestJSON-1091243525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-620cd253-8697-4dc5-acbf-a6db48d27e29 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:51 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d9f5782c-5e98-4666-98d2-6df8af85ea08 tempest-VolumesTestJSON-454221321 None] Lock "cinder-quobyte-0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca" released by "delete_volume" :: held 1.541s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:16:51 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-d9f5782c-5e98-4666-98d2-6df8af85ea08 tempest-VolumesTestJSON-454221321 None] Created reservations ['fe04bbf7-8e2e-4296-ba25-d4cbc14510f0', '465a0c91-4643-46de-856a-79eac804445c', '6c617c7f-ee54-4e8c-ba7b-f1fd728e1d8d', '420dcf5c-6428-4bcc-8f21-3826be816c3d'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:16:51 devstack quobyte-client[84065]: System call of process 89138 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:16:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d9f5782c-5e98-4666-98d2-6df8af85ea08 tempest-VolumesTestJSON-454221321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:16:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d9f5782c-5e98-4666-98d2-6df8af85ea08 tempest-VolumesTestJSON-454221321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:16:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d9f5782c-5e98-4666-98d2-6df8af85ea08 tempest-VolumesTestJSON-454221321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:16:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d9f5782c-5e98-4666-98d2-6df8af85ea08 tempest-VolumesTestJSON-454221321 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:16:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d9f5782c-5e98-4666-98d2-6df8af85ea08 tempest-VolumesTestJSON-454221321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:16:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d9f5782c-5e98-4666-98d2-6df8af85ea08 tempest-VolumesTestJSON-454221321 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-d81c44bf-21f3-4a79-ad5c-534eba2453f2 req-71c20dab-027d-4e76-ad22-9da97a9dc598 tempest-AttachVolumeShelveTestJSON-1091243525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-620cd253-8697-4dc5-acbf-a6db48d27e29" returned: 0 in 1.104s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-d81c44bf-21f3-4a79-ad5c-534eba2453f2 req-71c20dab-027d-4e76-ad22-9da97a9dc598 tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.238s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:16:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d9f5782c-5e98-4666-98d2-6df8af85ea08 tempest-VolumesTestJSON-454221321 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.349s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:52 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-d9f5782c-5e98-4666-98d2-6df8af85ea08 tempest-VolumesTestJSON-454221321 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:16:52 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-d9f5782c-5e98-4666-98d2-6df8af85ea08 tempest-VolumesTestJSON-454221321 None] Deleted volume successfully.
Sep 22 23:16:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-d81c44bf-21f3-4a79-ad5c-534eba2453f2 req-71c20dab-027d-4e76-ad22-9da97a9dc598 tempest-AttachVolumeShelveTestJSON-1091243525 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-620cd253-8697-4dc5-acbf-a6db48d27e29', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a96837f7-9c9a-4623-87c0-4cb34dad88f9', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:16:52 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-d81c44bf-21f3-4a79-ad5c-534eba2453f2 req-71c20dab-027d-4e76-ad22-9da97a9dc598 tempest-AttachVolumeShelveTestJSON-1091243525 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:16:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d9f5782c-5e98-4666-98d2-6df8af85ea08 tempest-VolumesTestJSON-454221321 None] Lock "cinder-0b3f1e23-ac4e-4ed8-822d-6fe5a6838eca-delete_volume" released by "delete_volume" :: held 3.235s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:16:52 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=36,cinder:UPDATE=52,cinder:DELETE=9,cinder:INSERT=7 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:16:52 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-d81c44bf-21f3-4a79-ad5c-534eba2453f2 req-71c20dab-027d-4e76-ad22-9da97a9dc598 tempest-AttachVolumeShelveTestJSON-1091243525 None] attachment_update completed successfully.
Sep 22 23:16:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6d1d66ea-a30f-4aee-8d52-97a7d4bdd763 tempest-VolumesTestJSON-454221321 None] Acquiring lock "cinder-f9e5469a-1592-4f03-9a77-5119c6f1c481-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:16:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6d1d66ea-a30f-4aee-8d52-97a7d4bdd763 tempest-VolumesTestJSON-454221321 None] Lock "cinder-f9e5469a-1592-4f03-9a77-5119c6f1c481-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:16:52 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-6d1d66ea-a30f-4aee-8d52-97a7d4bdd763 tempest-VolumesTestJSON-454221321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:16:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6d1d66ea-a30f-4aee-8d52-97a7d4bdd763 tempest-VolumesTestJSON-454221321 None] Acquiring lock "cinder-quobyte-f9e5469a-1592-4f03-9a77-5119c6f1c481" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:16:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6d1d66ea-a30f-4aee-8d52-97a7d4bdd763 tempest-VolumesTestJSON-454221321 None] Lock "cinder-quobyte-f9e5469a-1592-4f03-9a77-5119c6f1c481" acquired by "delete_volume" :: waited 0.015s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:16:53 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[184ebe86-0869-42f9-ad85-172e34f5049c]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:16:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6d1d66ea-a30f-4aee-8d52-97a7d4bdd763 tempest-VolumesTestJSON-454221321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f9e5469a-1592-4f03-9a77-5119c6f1c481 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6d1d66ea-a30f-4aee-8d52-97a7d4bdd763 tempest-VolumesTestJSON-454221321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f9e5469a-1592-4f03-9a77-5119c6f1c481" returned: 0 in 0.644s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6d1d66ea-a30f-4aee-8d52-97a7d4bdd763 tempest-VolumesTestJSON-454221321 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f9e5469a-1592-4f03-9a77-5119c6f1c481 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6d1d66ea-a30f-4aee-8d52-97a7d4bdd763 tempest-VolumesTestJSON-454221321 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f9e5469a-1592-4f03-9a77-5119c6f1c481" returned: 0 in 0.174s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6d1d66ea-a30f-4aee-8d52-97a7d4bdd763 tempest-VolumesTestJSON-454221321 None] Lock "cinder-quobyte-f9e5469a-1592-4f03-9a77-5119c6f1c481" released by "delete_volume" :: held 1.079s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:16:54 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=55,cinder:UPDATE=60,cinder:DELETE=3,cinder:INSERT=13 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:16:54 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-6d1d66ea-a30f-4aee-8d52-97a7d4bdd763 tempest-VolumesTestJSON-454221321 None] Created reservations ['de2bbd34-8a4f-44bf-92b9-3da834434123', '7511bc39-cb63-4a86-8502-ad4696c4397e', 'abf818b3-3faf-44c3-86f1-07c12f384cf0', '5328e753-9fdc-4554-8901-740953abde5f'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:16:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6d1d66ea-a30f-4aee-8d52-97a7d4bdd763 tempest-VolumesTestJSON-454221321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:16:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6d1d66ea-a30f-4aee-8d52-97a7d4bdd763 tempest-VolumesTestJSON-454221321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:16:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6d1d66ea-a30f-4aee-8d52-97a7d4bdd763 tempest-VolumesTestJSON-454221321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:16:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6d1d66ea-a30f-4aee-8d52-97a7d4bdd763 tempest-VolumesTestJSON-454221321 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:16:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6d1d66ea-a30f-4aee-8d52-97a7d4bdd763 tempest-VolumesTestJSON-454221321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:16:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6d1d66ea-a30f-4aee-8d52-97a7d4bdd763 tempest-VolumesTestJSON-454221321 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:16:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6d1d66ea-a30f-4aee-8d52-97a7d4bdd763 tempest-VolumesTestJSON-454221321 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.114s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:16:54 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-6d1d66ea-a30f-4aee-8d52-97a7d4bdd763 tempest-VolumesTestJSON-454221321 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:16:54 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-6d1d66ea-a30f-4aee-8d52-97a7d4bdd763 tempest-VolumesTestJSON-454221321 None] Deleted volume successfully.
Sep 22 23:16:55 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6d1d66ea-a30f-4aee-8d52-97a7d4bdd763 tempest-VolumesTestJSON-454221321 None] Lock "cinder-f9e5469a-1592-4f03-9a77-5119c6f1c481-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:17:04 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=8,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:17:04 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:INSERT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:17:30 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:17:30 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:17:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Flow 'volume_create_manager' (92362277-a1d0-4f48-9e97-94b48716fdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:17:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29224f0-6d78-4f29-89f6-7017f02a0888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:17:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29224f0-6d78-4f29-89f6-7017f02a0888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-424183520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8e78d0ad90d4241867b9f8080d4f0f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:17:30Z,use_quota=True,user_id='b10cbe9beadd419287f115838c55b40b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:17:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa15f63e-9c16-4cb0-9a4c-513141dbb540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:17:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa15f63e-9c16-4cb0-9a4c-513141dbb540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:17:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7f31e8-9438-41bd-9ef0-815877c2d16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:17:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7f31e8-9438-41bd-9ef0-815877c2d16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd52fdbbc-94da-4ffb-9a55-9a4c87dc2f70', 'volume_name': 'volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:17:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4558c2-db63-45ef-a0e4-adc6ed542dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:17:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4558c2-db63-45ef-a0e4-adc6ed542dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:17:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d35254a2-2902-4017-a2fd-4c2bebe4b8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:17:30 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Volume d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70', 'volume_size': 1}
Sep 22 23:17:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:17:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:17:30 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-424183520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8e78d0ad90d4241867b9f8080d4f0f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:17:30Z,use_quota=True,user_id='b10cbe9beadd419287f115838c55b40b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:17:30 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Creating volume d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:17:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:17:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:17:31 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:17:31 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:17:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:17:31 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:17:31 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:17:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:31 devstack quobyte-client[84065]: System call of process 89698 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:17:31 devstack quobyte-client[84065]: System call of process 89698 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:17:31 devstack quobyte-client[84065]: System call of process 89698 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:17:31 devstack quobyte-client[84065]: System call of process 89698 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:17:31 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=21, name=volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:17:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 1073741824" returned: 0 in 0.513s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" returned: 0 in 0.128s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:31 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] <== create_volume: return (736ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:17:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:17:31 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d35254a2-2902-4017-a2fd-4c2bebe4b8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:17:31 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13152e7f-2b4c-4e6b-a8e5-c01147783d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:17:32 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Volume volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 (d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70): created successfully
Sep 22 23:17:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13152e7f-2b4c-4e6b-a8e5-c01147783d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:17:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Flow 'volume_create_manager' (92362277-a1d0-4f48-9e97-94b48716fdc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:17:32 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-a65e0292-a1da-445d-930f-285d8dd2feea tempest-SnapshotsActionsTest-1877452951 None] Created volume successfully.
Sep 22 23:17:35 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:17:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:17:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.010s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:17:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] Creating offline snapshot 4e203340-0ee7-4fb5-b563-b61384772c77 of volume d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:17:35 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[98284b7f-632d-47bc-8863-e5fb80ef3246]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:17:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:37 devstack quobyte-client[84065]: System call of process 89765 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:17:37 devstack quobyte-client[84065]: System call of process 89765 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:17:37 devstack quobyte-client[84065]: System call of process 89765 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:17:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" returned: 0 in 2.258s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:38 devstack quobyte-client[84065]: System call of process 89796 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:17:38 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=22, name=volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:17:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 1G" returned: 0 in 0.917s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:38 devstack quobyte-client[84065]: System call of process 89812 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:17:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] CMD "qemu-img rebase -u -b volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77" returned: 0 in 0.548s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:17:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77" returned: 0 in 0.152s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:17:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77" returned: 0 in 0.213s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.info" returned: 0 in 0.165s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.info is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:17:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.info" returned: 0 in 0.193s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.555s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:17:41 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-d0a22f76-eca2-4ab1-bd0b-a9fb01e357ea tempest-SnapshotsActionsTest-1877452951 None] Create snapshot completed successfully
Sep 22 23:17:44 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-f995f811-604c-4a2a-9451-b61f178460e0 tempest-SnapshotsActionsTest-1877452951 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:17:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f995f811-604c-4a2a-9451-b61f178460e0 tempest-SnapshotsActionsTest-1877452951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:17:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f995f811-604c-4a2a-9451-b61f178460e0 tempest-SnapshotsActionsTest-1877452951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.009s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:17:44 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-f995f811-604c-4a2a-9451-b61f178460e0 tempest-SnapshotsActionsTest-1877452951 None] Creating offline snapshot 65e264e2-1a87-4140-9096-578e0d918f93 of volume d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:17:44 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14128da-121e-460e-b702-321c4d761a5a]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:17:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f995f811-604c-4a2a-9451-b61f178460e0 tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f995f811-604c-4a2a-9451-b61f178460e0 tempest-SnapshotsActionsTest-1877452951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77" returned: 0 in 0.505s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:45 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-f995f811-604c-4a2a-9451-b61f178460e0 tempest-SnapshotsActionsTest-1877452951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:17:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f995f811-604c-4a2a-9451-b61f178460e0 tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.65e264e2-1a87-4140-9096-578e0d918f93 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:45 devstack quobyte-client[84065]: System call of process 89852 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:17:45 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=24, name=volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.65e264e2-1a87-4140-9096-578e0d918f93, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:17:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f995f811-604c-4a2a-9451-b61f178460e0 tempest-SnapshotsActionsTest-1877452951 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.65e264e2-1a87-4140-9096-578e0d918f93 1G" returned: 0 in 0.521s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f995f811-604c-4a2a-9451-b61f178460e0 tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.65e264e2-1a87-4140-9096-578e0d918f93 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:45 devstack quobyte-client[84065]: System call of process 89855 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:17:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f995f811-604c-4a2a-9451-b61f178460e0 tempest-SnapshotsActionsTest-1877452951 None] CMD "qemu-img rebase -u -b volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.65e264e2-1a87-4140-9096-578e0d918f93" returned: 0 in 0.331s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-f995f811-604c-4a2a-9451-b61f178460e0 tempest-SnapshotsActionsTest-1877452951 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.65e264e2-1a87-4140-9096-578e0d918f93 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:17:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f995f811-604c-4a2a-9451-b61f178460e0 tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.65e264e2-1a87-4140-9096-578e0d918f93 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f995f811-604c-4a2a-9451-b61f178460e0 tempest-SnapshotsActionsTest-1877452951 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.65e264e2-1a87-4140-9096-578e0d918f93" returned: 0 in 0.186s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-f995f811-604c-4a2a-9451-b61f178460e0 tempest-SnapshotsActionsTest-1877452951 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:17:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f995f811-604c-4a2a-9451-b61f178460e0 tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.65e264e2-1a87-4140-9096-578e0d918f93 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f995f811-604c-4a2a-9451-b61f178460e0 tempest-SnapshotsActionsTest-1877452951 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.65e264e2-1a87-4140-9096-578e0d918f93" returned: 0 in 0.261s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f995f811-604c-4a2a-9451-b61f178460e0 tempest-SnapshotsActionsTest-1877452951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.459s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:17:47 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-f995f811-604c-4a2a-9451-b61f178460e0 tempest-SnapshotsActionsTest-1877452951 None] Create snapshot completed successfully
Sep 22 23:17:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:17:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:17:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:17:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:17:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:17:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.109s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:17:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:48 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] Acquiring lock "cinder-65e264e2-1a87-4140-9096-578e0d918f93-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:17:48 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-65e264e2-1a87-4140-9096-578e0d918f93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.384s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:17:48 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:17:48 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] Acquiring lock "cinder-quobyte-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:17:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 1.165s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:49 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:17:49 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-quobyte-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" acquired by "delete_snapshot" :: waited 0.310s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:17:49 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] Acquiring lock "cinder-quobyte-65e264e2-1a87-4140-9096-578e0d918f93" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:17:49 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-quobyte-65e264e2-1a87-4140-9096-578e0d918f93" acquired by "_delete_snapshot" :: waited 0.112s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:17:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] Deleting offline snapshot 65e264e2-1a87-4140-9096-578e0d918f93 of volume d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:17:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] snapshot_file for this snap is: volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.65e264e2-1a87-4140-9096-578e0d918f93 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:17:49 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5721649f-7637-4580-a6d0-cc56108d29c4]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:17:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.65e264e2-1a87-4140-9096-578e0d918f93 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:50 devstack quobyte-client[84065]: System call of process 89866 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:17:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.65e264e2-1a87-4140-9096-578e0d918f93" returned: 0 in 1.157s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:50 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:17:50 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[58241d22-5af6-46df-9a9a-65053c8b96c7]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:17:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:52 devstack quobyte-client[84065]: System call of process 89869 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:17:52 devstack quobyte-client[84065]: System call of process 89869 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:17:52 devstack quobyte-client[84065]: System call of process 89869 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:17:52 devstack quobyte-client[84065]: System call of process 89869 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:17:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77" returned: 0 in 1.457s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:52 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:17:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.65e264e2-1a87-4140-9096-578e0d918f93 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:52 devstack quobyte-client[84065]: System call of process 89873 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:17:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.65e264e2-1a87-4140-9096-578e0d918f93" returned: 0 in 0.691s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.65e264e2-1a87-4140-9096-578e0d918f93 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.65e264e2-1a87-4140-9096-578e0d918f93" returned: 0 in 0.194s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:53 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-quobyte-65e264e2-1a87-4140-9096-578e0d918f93" released by "_delete_snapshot" :: held 4.244s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:17:53 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-quobyte-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" released by "delete_snapshot" :: held 4.376s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:17:53 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] Created reservations ['f2aca7eb-1060-40c9-99b8-d220762fd69e', '7c495d98-4b88-487d-955f-9d84f97bce65', 'fc0a3d37-752c-479e-b522-754ea4ff32bd', '1b1cba01-1ecf-495f-9688-1f3740d75861'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:17:54 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] Delete snapshot completed successfully.
Sep 22 23:17:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-62b197dd-5138-4c86-a33e-26746b37e70c tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-65e264e2-1a87-4140-9096-578e0d918f93-delete_snapshot" released by "delete_snapshot" :: held 5.269s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:17:55 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-80ede6ba-4dba-446e-9f51-7947da92f5bd tempest-SnapshotsActionsTest-1877452951 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:17:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-80ede6ba-4dba-446e-9f51-7947da92f5bd tempest-SnapshotsActionsTest-1877452951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:17:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-80ede6ba-4dba-446e-9f51-7947da92f5bd tempest-SnapshotsActionsTest-1877452951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:17:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-80ede6ba-4dba-446e-9f51-7947da92f5bd tempest-SnapshotsActionsTest-1877452951 None] Creating offline snapshot bccd3ed8-6753-4cd4-9a23-d15c0f34d42d of volume d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:17:55 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1500c8-354d-447f-a84c-b634c892b557]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:17:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-80ede6ba-4dba-446e-9f51-7947da92f5bd tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:56 devstack quobyte-client[84065]: System call of process 89883 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:17:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-80ede6ba-4dba-446e-9f51-7947da92f5bd tempest-SnapshotsActionsTest-1877452951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77" returned: 0 in 0.502s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:56 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-80ede6ba-4dba-446e-9f51-7947da92f5bd tempest-SnapshotsActionsTest-1877452951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:17:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-80ede6ba-4dba-446e-9f51-7947da92f5bd tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.bccd3ed8-6753-4cd4-9a23-d15c0f34d42d 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:56 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=25, name=volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.bccd3ed8-6753-4cd4-9a23-d15c0f34d42d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:17:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-80ede6ba-4dba-446e-9f51-7947da92f5bd tempest-SnapshotsActionsTest-1877452951 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.bccd3ed8-6753-4cd4-9a23-d15c0f34d42d 1G" returned: 0 in 0.756s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-80ede6ba-4dba-446e-9f51-7947da92f5bd tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.bccd3ed8-6753-4cd4-9a23-d15c0f34d42d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-80ede6ba-4dba-446e-9f51-7947da92f5bd tempest-SnapshotsActionsTest-1877452951 None] CMD "qemu-img rebase -u -b volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.bccd3ed8-6753-4cd4-9a23-d15c0f34d42d" returned: 0 in 0.347s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-80ede6ba-4dba-446e-9f51-7947da92f5bd tempest-SnapshotsActionsTest-1877452951 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.bccd3ed8-6753-4cd4-9a23-d15c0f34d42d is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:17:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-80ede6ba-4dba-446e-9f51-7947da92f5bd tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.bccd3ed8-6753-4cd4-9a23-d15c0f34d42d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-80ede6ba-4dba-446e-9f51-7947da92f5bd tempest-SnapshotsActionsTest-1877452951 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.bccd3ed8-6753-4cd4-9a23-d15c0f34d42d" returned: 0 in 0.278s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-80ede6ba-4dba-446e-9f51-7947da92f5bd tempest-SnapshotsActionsTest-1877452951 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:17:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-80ede6ba-4dba-446e-9f51-7947da92f5bd tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.bccd3ed8-6753-4cd4-9a23-d15c0f34d42d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-80ede6ba-4dba-446e-9f51-7947da92f5bd tempest-SnapshotsActionsTest-1877452951 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.bccd3ed8-6753-4cd4-9a23-d15c0f34d42d" returned: 0 in 0.137s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-80ede6ba-4dba-446e-9f51-7947da92f5bd tempest-SnapshotsActionsTest-1877452951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.469s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:17:58 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-80ede6ba-4dba-446e-9f51-7947da92f5bd tempest-SnapshotsActionsTest-1877452951 None] Create snapshot completed successfully
Sep 22 23:17:59 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] Acquiring lock "cinder-bccd3ed8-6753-4cd4-9a23-d15c0f34d42d-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:17:59 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-bccd3ed8-6753-4cd4-9a23-d15c0f34d42d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:17:59 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:17:59 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] Acquiring lock "cinder-quobyte-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:17:59 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-quobyte-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:17:59 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] Acquiring lock "cinder-quobyte-bccd3ed8-6753-4cd4-9a23-d15c0f34d42d" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:17:59 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-quobyte-bccd3ed8-6753-4cd4-9a23-d15c0f34d42d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:17:59 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] Deleting offline snapshot bccd3ed8-6753-4cd4-9a23-d15c0f34d42d of volume d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:17:59 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] snapshot_file for this snap is: volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.bccd3ed8-6753-4cd4-9a23-d15c0f34d42d {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:17:59 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2eeaad-5f71-4f5f-850d-7f7b4d0dd190]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:17:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.bccd3ed8-6753-4cd4-9a23-d15c0f34d42d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:17:59 devstack quobyte-client[84065]: System call of process 89895 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:17:59 devstack quobyte-client[84065]: System call of process 89895 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:17:59 devstack quobyte-client[84065]: System call of process 89895 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:17:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.bccd3ed8-6753-4cd4-9a23-d15c0f34d42d" returned: 0 in 0.583s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:17:59 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:17:59 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a86cad-769b-4f0c-bcf3-93a285f6b539]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:17:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:00 devstack quobyte-client[84065]: System call of process 89898 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:18:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77" returned: 0 in 0.524s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:18:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.bccd3ed8-6753-4cd4-9a23-d15c0f34d42d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.bccd3ed8-6753-4cd4-9a23-d15c0f34d42d" returned: 0 in 0.575s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.bccd3ed8-6753-4cd4-9a23-d15c0f34d42d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.bccd3ed8-6753-4cd4-9a23-d15c0f34d42d" returned: 0 in 0.213s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:01 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-quobyte-bccd3ed8-6753-4cd4-9a23-d15c0f34d42d" released by "_delete_snapshot" :: held 2.394s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:18:01 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-quobyte-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" released by "delete_snapshot" :: held 2.430s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:18:02 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] Created reservations ['d2605d77-58c1-42f6-aa9a-65525a71ca94', '80fa8002-c5e4-4e46-87ac-5feb51f689a2', 'c1bd1b63-e803-4436-9ce6-a834ddec5f74', 'c3f6043b-e106-43a0-9a01-18fb64401a51'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:18:02 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] Delete snapshot completed successfully.
Sep 22 23:18:02 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c2721b10-f118-4c4d-bf72-daf3366be9a6 tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-bccd3ed8-6753-4cd4-9a23-d15c0f34d42d-delete_snapshot" released by "delete_snapshot" :: held 3.320s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:18:04 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-0606181d-e598-478a-9220-7529e6972b38 tempest-SnapshotsActionsTest-1877452951 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:18:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0606181d-e598-478a-9220-7529e6972b38 tempest-SnapshotsActionsTest-1877452951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:18:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0606181d-e598-478a-9220-7529e6972b38 tempest-SnapshotsActionsTest-1877452951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:18:04 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-0606181d-e598-478a-9220-7529e6972b38 tempest-SnapshotsActionsTest-1877452951 None] Creating offline snapshot 860aef43-7c4b-494b-b8d4-b600c85d7d4d of volume d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:18:04 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8acab3-4c3d-4335-bf63-2b20e5803e02]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:18:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0606181d-e598-478a-9220-7529e6972b38 tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:05 devstack quobyte-client[84065]: System call of process 89906 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:18:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0606181d-e598-478a-9220-7529e6972b38 tempest-SnapshotsActionsTest-1877452951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77" returned: 0 in 0.937s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-0606181d-e598-478a-9220-7529e6972b38 tempest-SnapshotsActionsTest-1877452951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:18:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0606181d-e598-478a-9220-7529e6972b38 tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.860aef43-7c4b-494b-b8d4-b600c85d7d4d 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:05 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=26, name=volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.860aef43-7c4b-494b-b8d4-b600c85d7d4d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:18:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0606181d-e598-478a-9220-7529e6972b38 tempest-SnapshotsActionsTest-1877452951 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.860aef43-7c4b-494b-b8d4-b600c85d7d4d 1G" returned: 0 in 0.475s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0606181d-e598-478a-9220-7529e6972b38 tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.860aef43-7c4b-494b-b8d4-b600c85d7d4d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0606181d-e598-478a-9220-7529e6972b38 tempest-SnapshotsActionsTest-1877452951 None] CMD "qemu-img rebase -u -b volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.860aef43-7c4b-494b-b8d4-b600c85d7d4d" returned: 0 in 0.227s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:06 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-0606181d-e598-478a-9220-7529e6972b38 tempest-SnapshotsActionsTest-1877452951 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.860aef43-7c4b-494b-b8d4-b600c85d7d4d is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:18:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0606181d-e598-478a-9220-7529e6972b38 tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.860aef43-7c4b-494b-b8d4-b600c85d7d4d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0606181d-e598-478a-9220-7529e6972b38 tempest-SnapshotsActionsTest-1877452951 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.860aef43-7c4b-494b-b8d4-b600c85d7d4d" returned: 0 in 0.203s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:06 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-0606181d-e598-478a-9220-7529e6972b38 tempest-SnapshotsActionsTest-1877452951 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:18:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0606181d-e598-478a-9220-7529e6972b38 tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.860aef43-7c4b-494b-b8d4-b600c85d7d4d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0606181d-e598-478a-9220-7529e6972b38 tempest-SnapshotsActionsTest-1877452951 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.860aef43-7c4b-494b-b8d4-b600c85d7d4d" returned: 0 in 0.507s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0606181d-e598-478a-9220-7529e6972b38 tempest-SnapshotsActionsTest-1877452951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.820s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:18:07 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-0606181d-e598-478a-9220-7529e6972b38 tempest-SnapshotsActionsTest-1877452951 None] Create snapshot completed successfully
Sep 22 23:18:09 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] Acquiring lock "cinder-860aef43-7c4b-494b-b8d4-b600c85d7d4d-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:18:09 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-860aef43-7c4b-494b-b8d4-b600c85d7d4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:18:09 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:18:09 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] Acquiring lock "cinder-quobyte-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:18:09 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-quobyte-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" acquired by "delete_snapshot" :: waited 0.053s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:18:09 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] Acquiring lock "cinder-quobyte-860aef43-7c4b-494b-b8d4-b600c85d7d4d" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:18:09 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-quobyte-860aef43-7c4b-494b-b8d4-b600c85d7d4d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:18:09 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] Deleting offline snapshot 860aef43-7c4b-494b-b8d4-b600c85d7d4d of volume d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:18:09 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] snapshot_file for this snap is: volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.860aef43-7c4b-494b-b8d4-b600c85d7d4d {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:18:09 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7866912f-d5cb-4123-af5e-835171a48a10]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:18:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.860aef43-7c4b-494b-b8d4-b600c85d7d4d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.860aef43-7c4b-494b-b8d4-b600c85d7d4d" returned: 0 in 0.551s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:10 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:18:10 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c855698d-f4b0-47e8-8c03-c29de6edc5c6]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:18:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:10 devstack quobyte-client[84065]: System call of process 89920 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:18:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77" returned: 0 in 0.580s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:10 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:18:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.860aef43-7c4b-494b-b8d4-b600c85d7d4d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:10 devstack quobyte-client[84065]: System call of process 89927 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:18:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.860aef43-7c4b-494b-b8d4-b600c85d7d4d" returned: 0 in 0.994s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.860aef43-7c4b-494b-b8d4-b600c85d7d4d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.860aef43-7c4b-494b-b8d4-b600c85d7d4d" returned: 0 in 0.276s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-quobyte-860aef43-7c4b-494b-b8d4-b600c85d7d4d" released by "_delete_snapshot" :: held 3.080s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:18:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-quobyte-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" released by "delete_snapshot" :: held 3.152s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:18:12 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] Created reservations ['f729bfad-ee84-4b9a-89c2-0cf8f380fe66', '96d8d5ec-fd51-47ef-ad84-515365d1fc89', '7352594f-5f19-4a96-88d1-896a6f30cd74', 'f8c9e6b9-9b76-4513-84f0-21e72bd21c86'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:18:12 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] Delete snapshot completed successfully.
Sep 22 23:18:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c6784022-3333-40d5-b6b4-493b505db717 tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-860aef43-7c4b-494b-b8d4-b600c85d7d4d-delete_snapshot" released by "delete_snapshot" :: held 3.718s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:18:14 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-5ff5c3d7-fe06-4e9a-80e6-e59a42e6194b tempest-SnapshotsActionsTest-1877452951 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:18:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5ff5c3d7-fe06-4e9a-80e6-e59a42e6194b tempest-SnapshotsActionsTest-1877452951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:18:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5ff5c3d7-fe06-4e9a-80e6-e59a42e6194b tempest-SnapshotsActionsTest-1877452951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:18:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-5ff5c3d7-fe06-4e9a-80e6-e59a42e6194b tempest-SnapshotsActionsTest-1877452951 None] Creating offline snapshot 896adaa8-efac-4cf5-b02e-b10de8584966 of volume d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:18:14 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6effe9-3748-4560-bf74-050652609c59]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:18:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ff5c3d7-fe06-4e9a-80e6-e59a42e6194b tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:14 devstack quobyte-client[84065]: System call of process 89962 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:18:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ff5c3d7-fe06-4e9a-80e6-e59a42e6194b tempest-SnapshotsActionsTest-1877452951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77" returned: 0 in 0.546s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-5ff5c3d7-fe06-4e9a-80e6-e59a42e6194b tempest-SnapshotsActionsTest-1877452951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:18:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ff5c3d7-fe06-4e9a-80e6-e59a42e6194b tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.896adaa8-efac-4cf5-b02e-b10de8584966 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:15 devstack quobyte-client[84065]: System call of process 89965 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:18:15 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=27, name=volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.896adaa8-efac-4cf5-b02e-b10de8584966, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:18:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ff5c3d7-fe06-4e9a-80e6-e59a42e6194b tempest-SnapshotsActionsTest-1877452951 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.896adaa8-efac-4cf5-b02e-b10de8584966 1G" returned: 0 in 0.483s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ff5c3d7-fe06-4e9a-80e6-e59a42e6194b tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.896adaa8-efac-4cf5-b02e-b10de8584966 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ff5c3d7-fe06-4e9a-80e6-e59a42e6194b tempest-SnapshotsActionsTest-1877452951 None] CMD "qemu-img rebase -u -b volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.896adaa8-efac-4cf5-b02e-b10de8584966" returned: 0 in 0.251s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:15 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-5ff5c3d7-fe06-4e9a-80e6-e59a42e6194b tempest-SnapshotsActionsTest-1877452951 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.896adaa8-efac-4cf5-b02e-b10de8584966 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:18:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ff5c3d7-fe06-4e9a-80e6-e59a42e6194b tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.896adaa8-efac-4cf5-b02e-b10de8584966 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ff5c3d7-fe06-4e9a-80e6-e59a42e6194b tempest-SnapshotsActionsTest-1877452951 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.896adaa8-efac-4cf5-b02e-b10de8584966" returned: 0 in 0.141s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:15 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-5ff5c3d7-fe06-4e9a-80e6-e59a42e6194b tempest-SnapshotsActionsTest-1877452951 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:18:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ff5c3d7-fe06-4e9a-80e6-e59a42e6194b tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.896adaa8-efac-4cf5-b02e-b10de8584966 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ff5c3d7-fe06-4e9a-80e6-e59a42e6194b tempest-SnapshotsActionsTest-1877452951 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.896adaa8-efac-4cf5-b02e-b10de8584966" returned: 0 in 0.110s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5ff5c3d7-fe06-4e9a-80e6-e59a42e6194b tempest-SnapshotsActionsTest-1877452951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.843s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:18:16 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-5ff5c3d7-fe06-4e9a-80e6-e59a42e6194b tempest-SnapshotsActionsTest-1877452951 None] Create snapshot completed successfully
Sep 22 23:18:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] Acquiring lock "cinder-896adaa8-efac-4cf5-b02e-b10de8584966-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:18:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-896adaa8-efac-4cf5-b02e-b10de8584966-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:18:17 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:18:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] Acquiring lock "cinder-quobyte-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:18:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-quobyte-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:18:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] Acquiring lock "cinder-quobyte-896adaa8-efac-4cf5-b02e-b10de8584966" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:18:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-quobyte-896adaa8-efac-4cf5-b02e-b10de8584966" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:18:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] Deleting offline snapshot 896adaa8-efac-4cf5-b02e-b10de8584966 of volume d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:18:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] snapshot_file for this snap is: volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.896adaa8-efac-4cf5-b02e-b10de8584966 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:18:17 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9106e7b5-d72d-473c-b851-4889abe56c89]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:18:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.896adaa8-efac-4cf5-b02e-b10de8584966 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:18 devstack quobyte-client[84065]: System call of process 89975 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:18:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.896adaa8-efac-4cf5-b02e-b10de8584966" returned: 0 in 0.523s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:18:18 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a016bf-9aa8-4711-b891-7067e2b036ea]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:18:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77" returned: 0 in 0.695s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:19 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:18:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.896adaa8-efac-4cf5-b02e-b10de8584966 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:19 devstack quobyte-client[84065]: System call of process 89983 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:18:19 devstack quobyte-client[84065]: System call of process 89983 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:18:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.896adaa8-efac-4cf5-b02e-b10de8584966" returned: 0 in 0.375s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.896adaa8-efac-4cf5-b02e-b10de8584966 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.896adaa8-efac-4cf5-b02e-b10de8584966" returned: 0 in 0.124s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-quobyte-896adaa8-efac-4cf5-b02e-b10de8584966" released by "_delete_snapshot" :: held 2.200s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:18:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-quobyte-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" released by "delete_snapshot" :: held 2.309s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:18:20 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] Created reservations ['691dd648-1e25-4a60-9765-c868ab5b22a7', 'dd00b8b6-9946-46a3-b56d-9abc3aed348c', 'fbe9ef20-33ae-42fd-89d6-bba60603ef51', '1f0322c5-e953-446e-9951-e2680090976f'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:18:20 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] Delete snapshot completed successfully.
Sep 22 23:18:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-09d63e95-77a1-4253-8a7f-dc2c03e2524c tempest-SnapshotsActionsTest-214427701 None] Lock "cinder-896adaa8-efac-4cf5-b02e-b10de8584966-delete_snapshot" released by "delete_snapshot" :: held 2.903s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:18:21 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] Acquiring lock "cinder-4e203340-0ee7-4fb5-b563-b61384772c77-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:18:21 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] Lock "cinder-4e203340-0ee7-4fb5-b563-b61384772c77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:18:21 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:18:21 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] Acquiring lock "cinder-quobyte-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:18:21 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] Lock "cinder-quobyte-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" acquired by "delete_snapshot" :: waited 0.052s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:18:21 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] Acquiring lock "cinder-quobyte-4e203340-0ee7-4fb5-b563-b61384772c77" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:18:21 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] Lock "cinder-quobyte-4e203340-0ee7-4fb5-b563-b61384772c77" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:18:21 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] Deleting offline snapshot 4e203340-0ee7-4fb5-b563-b61384772c77 of volume d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:18:21 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] snapshot_file for this snap is: volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:18:21 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9442cf-1d91-4377-8c68-059eb68cdc6b]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:18:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:22 devstack quobyte-client[84065]: System call of process 90009 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:18:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77" returned: 0 in 0.863s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:22 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:18:22 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8118f3-8245-49b6-9f77-9d74db96431c]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:18:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:23 devstack quobyte-client[84065]: System call of process 90018 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:18:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" returned: 0 in 1.070s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:24 devstack quobyte-client[84065]: System call of process 90024 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:18:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77" returned: 0 in 0.658s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70.4e203340-0ee7-4fb5-b563-b61384772c77" returned: 0 in 0.224s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:25 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] Lock "cinder-quobyte-4e203340-0ee7-4fb5-b563-b61384772c77" released by "_delete_snapshot" :: held 3.515s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:18:25 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] Lock "cinder-quobyte-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" released by "delete_snapshot" :: held 3.608s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:18:25 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=31,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=5 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:18:25 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=31,cinder:SELECT=25,cinder:DELETE=4,cinder:INSERT=11 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:18:25 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] Created reservations ['5235c4f6-3124-4df9-bf6e-d9dd10f8a818', '6e9e3d56-9037-4423-a246-68476933148d', 'c31ee41c-c451-4968-b3cc-48ce7303c2b7', '1662fc26-27aa-420b-9c2a-23da4406e4d4'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:18:26 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] Delete snapshot completed successfully.
Sep 22 23:18:26 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-984d769c-76dc-421a-be80-edce87504b1d tempest-SnapshotsActionsTest-1877452951 None] Lock "cinder-4e203340-0ee7-4fb5-b563-b61384772c77-delete_snapshot" released by "delete_snapshot" :: held 4.411s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:18:27 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-26a3b202-8580-4969-b0f0-f71aedaee4b7 tempest-SnapshotsActionsTest-1877452951 None] Acquiring lock "cinder-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:18:27 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-26a3b202-8580-4969-b0f0-f71aedaee4b7 tempest-SnapshotsActionsTest-1877452951 None] Lock "cinder-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:18:27 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-26a3b202-8580-4969-b0f0-f71aedaee4b7 tempest-SnapshotsActionsTest-1877452951 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:18:27 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-26a3b202-8580-4969-b0f0-f71aedaee4b7 tempest-SnapshotsActionsTest-1877452951 None] Acquiring lock "cinder-quobyte-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:18:27 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-26a3b202-8580-4969-b0f0-f71aedaee4b7 tempest-SnapshotsActionsTest-1877452951 None] Lock "cinder-quobyte-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" acquired by "delete_volume" :: waited 0.037s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:18:27 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3efef4-ce40-4dc1-aad5-fc4f00442574]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:18:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-26a3b202-8580-4969-b0f0-f71aedaee4b7 tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:28 devstack quobyte-client[84065]: System call of process 90042 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:18:28 devstack quobyte-client[84065]: System call of process 90042 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:18:28 devstack quobyte-client[84065]: System call of process 90042 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:18:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-26a3b202-8580-4969-b0f0-f71aedaee4b7 tempest-SnapshotsActionsTest-1877452951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" returned: 0 in 0.725s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-26a3b202-8580-4969-b0f0-f71aedaee4b7 tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-26a3b202-8580-4969-b0f0-f71aedaee4b7 tempest-SnapshotsActionsTest-1877452951 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" returned: 0 in 0.278s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:29 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-26a3b202-8580-4969-b0f0-f71aedaee4b7 tempest-SnapshotsActionsTest-1877452951 None] Lock "cinder-quobyte-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70" released by "delete_volume" :: held 1.354s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:18:29 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-26a3b202-8580-4969-b0f0-f71aedaee4b7 tempest-SnapshotsActionsTest-1877452951 None] Created reservations ['ab3f6a84-b4dd-43ac-85be-d4c5d4dde863', '11d9bf95-f4da-4bae-9701-55f3aebca8cd', '7aeeb93b-0d40-44c6-bdfb-b639b331b974', '869436f9-81d9-47ec-8737-fdf566dea3dc'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:18:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-26a3b202-8580-4969-b0f0-f71aedaee4b7 tempest-SnapshotsActionsTest-1877452951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:18:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-26a3b202-8580-4969-b0f0-f71aedaee4b7 tempest-SnapshotsActionsTest-1877452951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:18:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-26a3b202-8580-4969-b0f0-f71aedaee4b7 tempest-SnapshotsActionsTest-1877452951 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:18:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-26a3b202-8580-4969-b0f0-f71aedaee4b7 tempest-SnapshotsActionsTest-1877452951 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:18:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-26a3b202-8580-4969-b0f0-f71aedaee4b7 tempest-SnapshotsActionsTest-1877452951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:18:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-26a3b202-8580-4969-b0f0-f71aedaee4b7 tempest-SnapshotsActionsTest-1877452951 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-26a3b202-8580-4969-b0f0-f71aedaee4b7 tempest-SnapshotsActionsTest-1877452951 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.117s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:29 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-26a3b202-8580-4969-b0f0-f71aedaee4b7 tempest-SnapshotsActionsTest-1877452951 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:18:29 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-26a3b202-8580-4969-b0f0-f71aedaee4b7 tempest-SnapshotsActionsTest-1877452951 None] Deleted volume successfully.
Sep 22 23:18:29 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-26a3b202-8580-4969-b0f0-f71aedaee4b7 tempest-SnapshotsActionsTest-1877452951 None] Lock "cinder-d52fdbbc-94da-4ffb-9a55-9a4c87dc2f70-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:18:39 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=6,cinder:INSERT=7,cinder:UPDATE=9 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:18:39 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=11,cinder:UPDATE=18,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:18:45 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:18:45 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:18:45 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Flow 'volume_create_manager' (565a00f6-7bca-4f00-b278-62bd30425c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:18:45 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438e5323-1584-4e5f-ae64-e46269cc7cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:18:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438e5323-1584-4e5f-ae64-e46269cc7cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-219141055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e65843-3042-404e-b43e-817fe49c0f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d1fc668af54695af1c309aec7a47f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:18:46Z,use_quota=True,user_id='134e88462fa649f5afb12e4ec4de0b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:18:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83cf72ad-2bf6-4248-b1a8-3d2483777a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:18:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83cf72ad-2bf6-4248-b1a8-3d2483777a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:18:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e816a797-88fc-4032-90ed-deb7bdb5a050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:18:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e816a797-88fc-4032-90ed-deb7bdb5a050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13e65843-3042-404e-b43e-817fe49c0f27', 'volume_name': 'volume-13e65843-3042-404e-b43e-817fe49c0f27', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:18:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b317b0-4714-4d8b-8fa3-1a8745755b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:18:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b317b0-4714-4d8b-8fa3-1a8745755b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:18:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb21f80-a0b8-4f4c-9e1f-fa3817179245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:18:46 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Volume 13e65843-3042-404e-b43e-817fe49c0f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13e65843-3042-404e-b43e-817fe49c0f27', 'volume_size': 1}
Sep 22 23:18:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:18:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:18:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-219141055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e65843-3042-404e-b43e-817fe49c0f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d1fc668af54695af1c309aec7a47f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:18:46Z,use_quota=True,user_id='134e88462fa649f5afb12e4ec4de0b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:18:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Creating volume 13e65843-3042-404e-b43e-817fe49c0f27 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:18:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:18:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:18:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:18:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:18:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:18:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:18:46 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:18:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-13e65843-3042-404e-b43e-817fe49c0f27 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:46 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=28, name=volume-13e65843-3042-404e-b43e-817fe49c0f27, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:18:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-13e65843-3042-404e-b43e-817fe49c0f27 1073741824" returned: 0 in 0.557s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-13e65843-3042-404e-b43e-817fe49c0f27 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-13e65843-3042-404e-b43e-817fe49c0f27" returned: 0 in 0.145s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] <== create_volume: return (805ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:18:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:18:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb21f80-a0b8-4f4c-9e1f-fa3817179245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13e65843-3042-404e-b43e-817fe49c0f27', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:18:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720e74b1-7e6c-4a00-af43-92017313ad72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:18:47 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Volume volume-13e65843-3042-404e-b43e-817fe49c0f27 (13e65843-3042-404e-b43e-817fe49c0f27): created successfully
Sep 22 23:18:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720e74b1-7e6c-4a00-af43-92017313ad72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:18:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Flow 'volume_create_manager' (565a00f6-7bca-4f00-b278-62bd30425c83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:18:47 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-836e00f0-9b4d-4636-a626-5d855c060411 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Created volume successfully.
Sep 22 23:18:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:18:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:18:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:18:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:18:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:18:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:18:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.233s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:18:48 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0ee80056-dfc5-4126-baa1-76faef39e4c8 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Acquiring lock "cinder-13e65843-3042-404e-b43e-817fe49c0f27-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:18:48 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0ee80056-dfc5-4126-baa1-76faef39e4c8 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Lock "cinder-13e65843-3042-404e-b43e-817fe49c0f27-delete_volume" acquired by "delete_volume" :: waited 0.139s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:18:49 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-0ee80056-dfc5-4126-baa1-76faef39e4c8 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:18:49 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0ee80056-dfc5-4126-baa1-76faef39e4c8 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Acquiring lock "cinder-quobyte-13e65843-3042-404e-b43e-817fe49c0f27" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:18:49 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0ee80056-dfc5-4126-baa1-76faef39e4c8 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Lock "cinder-quobyte-13e65843-3042-404e-b43e-817fe49c0f27" acquired by "delete_volume" :: waited 0.022s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:18:49 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[625c5ecc-1cbe-4790-91ea-61020528dd0a]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:18:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0ee80056-dfc5-4126-baa1-76faef39e4c8 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-13e65843-3042-404e-b43e-817fe49c0f27 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:50 devstack quobyte-client[84065]: System call of process 90092 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:18:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0ee80056-dfc5-4126-baa1-76faef39e4c8 tempest-VolumeQuotasAdminTestJSON-1671483088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-13e65843-3042-404e-b43e-817fe49c0f27" returned: 0 in 0.623s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0ee80056-dfc5-4126-baa1-76faef39e4c8 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-13e65843-3042-404e-b43e-817fe49c0f27 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0ee80056-dfc5-4126-baa1-76faef39e4c8 tempest-VolumeQuotasAdminTestJSON-1671483088 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-13e65843-3042-404e-b43e-817fe49c0f27" returned: 0 in 0.139s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0ee80056-dfc5-4126-baa1-76faef39e4c8 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Lock "cinder-quobyte-13e65843-3042-404e-b43e-817fe49c0f27" released by "delete_volume" :: held 1.264s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:18:51 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-0ee80056-dfc5-4126-baa1-76faef39e4c8 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Created reservations ['a20e2cd1-9612-4db6-87ad-fe1fa62e917c', '4cfbac3d-cbac-482e-8332-97d87c34e5d4', 'f987132f-27c3-4518-86a5-a1ab107cd5c8', 'fd777b3f-147a-4374-bb5d-bfe5542a895a'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:18:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0ee80056-dfc5-4126-baa1-76faef39e4c8 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:18:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0ee80056-dfc5-4126-baa1-76faef39e4c8 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:18:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0ee80056-dfc5-4126-baa1-76faef39e4c8 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:18:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0ee80056-dfc5-4126-baa1-76faef39e4c8 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:18:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0ee80056-dfc5-4126-baa1-76faef39e4c8 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:18:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0ee80056-dfc5-4126-baa1-76faef39e4c8 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0ee80056-dfc5-4126-baa1-76faef39e4c8 tempest-VolumeQuotasAdminTestJSON-1671483088 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.430s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:52 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-0ee80056-dfc5-4126-baa1-76faef39e4c8 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:18:52 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-0ee80056-dfc5-4126-baa1-76faef39e4c8 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Deleted volume successfully.
Sep 22 23:18:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0ee80056-dfc5-4126-baa1-76faef39e4c8 tempest-VolumeQuotasAdminTestJSON-1671483088 None] Lock "cinder-13e65843-3042-404e-b43e-817fe49c0f27-delete_volume" released by "delete_volume" :: held 3.560s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:18:53 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Flow 'volume_create_manager' (bdcb6a5e-ab88-4e80-9205-ccf4d9982b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcabf656-1d9d-480e-88f6-d3fb783fe906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcabf656-1d9d-480e-88f6-d3fb783fe906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2058675597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8dc7bbe-771c-475a-af4d-ccb91771aac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d1fc668af54695af1c309aec7a47f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:18:53Z,use_quota=True,user_id='134e88462fa649f5afb12e4ec4de0b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6adefa-b800-4368-b47e-7ef6d5c5a156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6adefa-b800-4368-b47e-7ef6d5c5a156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72739c05-add2-43f2-8966-f463ec6b1d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72739c05-add2-43f2-8966-f463ec6b1d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8dc7bbe-771c-475a-af4d-ccb91771aac9', 'volume_name': 'volume-d8dc7bbe-771c-475a-af4d-ccb91771aac9', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309b6b98-97f8-40f9-879f-05d80ba517e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309b6b98-97f8-40f9-879f-05d80ba517e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f002daa5-cf75-4df8-be24-7161eefcc7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:18:53 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Volume d8dc7bbe-771c-475a-af4d-ccb91771aac9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8dc7bbe-771c-475a-af4d-ccb91771aac9', 'volume_size': 1}
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2058675597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8dc7bbe-771c-475a-af4d-ccb91771aac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d1fc668af54695af1c309aec7a47f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:18:53Z,use_quota=True,user_id='134e88462fa649f5afb12e4ec4de0b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Creating volume d8dc7bbe-771c-475a-af4d-ccb91771aac9 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:18:53 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:18:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d8dc7bbe-771c-475a-af4d-ccb91771aac9 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:53 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=29, name=volume-d8dc7bbe-771c-475a-af4d-ccb91771aac9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:18:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d8dc7bbe-771c-475a-af4d-ccb91771aac9 1073741824" returned: 0 in 0.563s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d8dc7bbe-771c-475a-af4d-ccb91771aac9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d8dc7bbe-771c-475a-af4d-ccb91771aac9" returned: 0 in 0.149s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] <== create_volume: return (836ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:18:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:18:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f002daa5-cf75-4df8-be24-7161eefcc7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8dc7bbe-771c-475a-af4d-ccb91771aac9', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:18:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e0e09ca-b45a-4c87-8bf1-a4811fe1fdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:18:54 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Volume volume-d8dc7bbe-771c-475a-af4d-ccb91771aac9 (d8dc7bbe-771c-475a-af4d-ccb91771aac9): created successfully
Sep 22 23:18:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e0e09ca-b45a-4c87-8bf1-a4811fe1fdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:18:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Flow 'volume_create_manager' (bdcb6a5e-ab88-4e80-9205-ccf4d9982b63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:18:54 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-a24c673d-159d-47d0-98be-d15d0eb068ac tempest-VolumeQuotasAdminTestJSON-1671483088 None] Created volume successfully.
Sep 22 23:18:56 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-b56f3c9b-5ea4-427c-9eea-1cc897a12c75 tempest-VolumeQuotasAdminTestJSON-215854299 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:18:56 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-b56f3c9b-5ea4-427c-9eea-1cc897a12c75 tempest-VolumeQuotasAdminTestJSON-215854299 None] Transfer volume completed successfully.
Sep 22 23:18:58 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b332b408-8a3f-40db-b8b4-8b1cb9037cba tempest-VolumeQuotasAdminTestJSON-685942351 None] Acquiring lock "cinder-d8dc7bbe-771c-475a-af4d-ccb91771aac9-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:18:58 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b332b408-8a3f-40db-b8b4-8b1cb9037cba tempest-VolumeQuotasAdminTestJSON-685942351 None] Lock "cinder-d8dc7bbe-771c-475a-af4d-ccb91771aac9-delete_volume" acquired by "delete_volume" :: waited 0.429s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:18:58 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-b332b408-8a3f-40db-b8b4-8b1cb9037cba tempest-VolumeQuotasAdminTestJSON-685942351 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:18:58 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b332b408-8a3f-40db-b8b4-8b1cb9037cba tempest-VolumeQuotasAdminTestJSON-685942351 None] Acquiring lock "cinder-quobyte-d8dc7bbe-771c-475a-af4d-ccb91771aac9" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:18:58 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b332b408-8a3f-40db-b8b4-8b1cb9037cba tempest-VolumeQuotasAdminTestJSON-685942351 None] Lock "cinder-quobyte-d8dc7bbe-771c-475a-af4d-ccb91771aac9" acquired by "delete_volume" :: waited 0.026s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:18:58 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4314c46c-3b6e-4504-8fa5-0871995f2593]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:18:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b332b408-8a3f-40db-b8b4-8b1cb9037cba tempest-VolumeQuotasAdminTestJSON-685942351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d8dc7bbe-771c-475a-af4d-ccb91771aac9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:18:59 devstack quobyte-client[84065]: System call of process 90143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:18:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b332b408-8a3f-40db-b8b4-8b1cb9037cba tempest-VolumeQuotasAdminTestJSON-685942351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d8dc7bbe-771c-475a-af4d-ccb91771aac9" returned: 0 in 0.898s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:18:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b332b408-8a3f-40db-b8b4-8b1cb9037cba tempest-VolumeQuotasAdminTestJSON-685942351 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d8dc7bbe-771c-475a-af4d-ccb91771aac9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b332b408-8a3f-40db-b8b4-8b1cb9037cba tempest-VolumeQuotasAdminTestJSON-685942351 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d8dc7bbe-771c-475a-af4d-ccb91771aac9" returned: 0 in 0.221s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:00 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b332b408-8a3f-40db-b8b4-8b1cb9037cba tempest-VolumeQuotasAdminTestJSON-685942351 None] Lock "cinder-quobyte-d8dc7bbe-771c-475a-af4d-ccb91771aac9" released by "delete_volume" :: held 1.399s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:19:00 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-b332b408-8a3f-40db-b8b4-8b1cb9037cba tempest-VolumeQuotasAdminTestJSON-685942351 None] Created reservations ['bcbf7abb-4445-4e57-aef4-3ee336a6b888', 'b040f75b-b836-4f72-adc7-5b11e0cbd70a', 'f629f317-ca41-4f2e-b01f-031815905bf9', 'bb36e9ff-1899-4a03-856c-1e3d56aa8c9a'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:19:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b332b408-8a3f-40db-b8b4-8b1cb9037cba tempest-VolumeQuotasAdminTestJSON-685942351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:19:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b332b408-8a3f-40db-b8b4-8b1cb9037cba tempest-VolumeQuotasAdminTestJSON-685942351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:19:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b332b408-8a3f-40db-b8b4-8b1cb9037cba tempest-VolumeQuotasAdminTestJSON-685942351 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:19:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b332b408-8a3f-40db-b8b4-8b1cb9037cba tempest-VolumeQuotasAdminTestJSON-685942351 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:19:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b332b408-8a3f-40db-b8b4-8b1cb9037cba tempest-VolumeQuotasAdminTestJSON-685942351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:19:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b332b408-8a3f-40db-b8b4-8b1cb9037cba tempest-VolumeQuotasAdminTestJSON-685942351 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b332b408-8a3f-40db-b8b4-8b1cb9037cba tempest-VolumeQuotasAdminTestJSON-685942351 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.281s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:01 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-b332b408-8a3f-40db-b8b4-8b1cb9037cba tempest-VolumeQuotasAdminTestJSON-685942351 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:19:01 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-b332b408-8a3f-40db-b8b4-8b1cb9037cba tempest-VolumeQuotasAdminTestJSON-685942351 None] Deleted volume successfully.
Sep 22 23:19:01 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b332b408-8a3f-40db-b8b4-8b1cb9037cba tempest-VolumeQuotasAdminTestJSON-685942351 None] Lock "cinder-d8dc7bbe-771c-475a-af4d-ccb91771aac9-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:19:10 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=26,cinder:SELECT=15,cinder:DELETE=1,cinder:INSERT=6 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:19:11 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=10,cinder:UPDATE=14,cinder:DELETE=3,cinder:INSERT=2 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:19:12 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Flow 'volume_create_manager' (4718b997-be14-49a6-b2b5-25bbfe367f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aaa161b-c28c-49dd-8448-e28b960247a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aaa161b-c28c-49dd-8448-e28b960247a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2036928287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0cb5b3-9109-4a6e-b110-185b49720e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9b3e0a670b045e4b4f2b81e52e025bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:19:12Z,use_quota=True,user_id='5b5f596c652d4a9db7f025710fcfe523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ae96b1-43fe-4b60-9608-db8782269083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ae96b1-43fe-4b60-9608-db8782269083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651030fc-ce2d-40b8-9bd3-3074337f2c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651030fc-ce2d-40b8-9bd3-3074337f2c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da0cb5b3-9109-4a6e-b110-185b49720e2d', 'volume_name': 'volume-da0cb5b3-9109-4a6e-b110-185b49720e2d', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c39bc6d-ea9c-4f81-b241-f238ed22441c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c39bc6d-ea9c-4f81-b241-f238ed22441c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb906eba-5e14-416d-be32-c586d89f14f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:12 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Volume da0cb5b3-9109-4a6e-b110-185b49720e2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da0cb5b3-9109-4a6e-b110-185b49720e2d', 'volume_size': 1}
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2036928287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0cb5b3-9109-4a6e-b110-185b49720e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9b3e0a670b045e4b4f2b81e52e025bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:19:12Z,use_quota=True,user_id='5b5f596c652d4a9db7f025710fcfe523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Creating volume da0cb5b3-9109-4a6e-b110-185b49720e2d {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:19:12 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:19:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-da0cb5b3-9109-4a6e-b110-185b49720e2d 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:12 devstack quobyte-client[84065]: System call of process 90178 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:19:12 devstack quobyte-client[84065]: System call of process 90178 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:19:12 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=30, name=volume-da0cb5b3-9109-4a6e-b110-185b49720e2d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:19:13 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-c4767465-4267-4482-8f1b-acb678370f42 req-3394cab8-e819-4faf-a7b0-1fea505796db tempest-AttachVolumeShelveTestJSON-1091243525 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:19:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-da0cb5b3-9109-4a6e-b110-185b49720e2d 1073741824" returned: 0 in 1.021s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:13 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-c4767465-4267-4482-8f1b-acb678370f42 req-3394cab8-e819-4faf-a7b0-1fea505796db tempest-AttachVolumeShelveTestJSON-1091243525 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:19:13 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-c4767465-4267-4482-8f1b-acb678370f42 req-3394cab8-e819-4faf-a7b0-1fea505796db tempest-AttachVolumeShelveTestJSON-1091243525 None] Terminate volume connection completed successfully.
Sep 22 23:19:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-c4767465-4267-4482-8f1b-acb678370f42 req-3394cab8-e819-4faf-a7b0-1fea505796db tempest-AttachVolumeShelveTestJSON-1091243525 None] Deleting attachment a96837f7-9c9a-4623-87c0-4cb34dad88f9. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:19:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-da0cb5b3-9109-4a6e-b110-185b49720e2d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-da0cb5b3-9109-4a6e-b110-185b49720e2d" returned: 0 in 0.281s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:13 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] <== create_volume: return (1413ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:19:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:19:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb906eba-5e14-416d-be32-c586d89f14f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da0cb5b3-9109-4a6e-b110-185b49720e2d', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e9793a5-5f98-4cf3-9404-58f1a8364c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:13 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Volume volume-da0cb5b3-9109-4a6e-b110-185b49720e2d (da0cb5b3-9109-4a6e-b110-185b49720e2d): created successfully
Sep 22 23:19:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e9793a5-5f98-4cf3-9404-58f1a8364c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:14 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Flow 'volume_create_manager' (4718b997-be14-49a6-b2b5-25bbfe367f32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:19:14 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-a69ef857-7716-4415-ab51-ea76686726d1 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Created volume successfully.
Sep 22 23:19:15 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-317aad0b-e1fb-4289-81e0-a750f2127f64 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Acquiring lock "cinder-da0cb5b3-9109-4a6e-b110-185b49720e2d-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:19:15 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-317aad0b-e1fb-4289-81e0-a750f2127f64 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Lock "cinder-da0cb5b3-9109-4a6e-b110-185b49720e2d-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:19:15 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-317aad0b-e1fb-4289-81e0-a750f2127f64 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:19:15 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-317aad0b-e1fb-4289-81e0-a750f2127f64 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Acquiring lock "cinder-quobyte-da0cb5b3-9109-4a6e-b110-185b49720e2d" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:19:15 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-317aad0b-e1fb-4289-81e0-a750f2127f64 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Lock "cinder-quobyte-da0cb5b3-9109-4a6e-b110-185b49720e2d" acquired by "delete_volume" :: waited 0.023s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:19:15 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4e6f65-c382-44a4-af49-6d5df36db5ab]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:19:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-317aad0b-e1fb-4289-81e0-a750f2127f64 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-da0cb5b3-9109-4a6e-b110-185b49720e2d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:16 devstack quobyte-client[84065]: System call of process 90217 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:19:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-317aad0b-e1fb-4289-81e0-a750f2127f64 tempest-VolumeQuotasNegativeTestJSON-622227092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-da0cb5b3-9109-4a6e-b110-185b49720e2d" returned: 0 in 0.437s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-317aad0b-e1fb-4289-81e0-a750f2127f64 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-da0cb5b3-9109-4a6e-b110-185b49720e2d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-317aad0b-e1fb-4289-81e0-a750f2127f64 tempest-VolumeQuotasNegativeTestJSON-622227092 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-da0cb5b3-9109-4a6e-b110-185b49720e2d" returned: 0 in 0.252s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:16 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-317aad0b-e1fb-4289-81e0-a750f2127f64 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Lock "cinder-quobyte-da0cb5b3-9109-4a6e-b110-185b49720e2d" released by "delete_volume" :: held 1.377s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:19:17 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-317aad0b-e1fb-4289-81e0-a750f2127f64 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Created reservations ['1771dc00-fc42-45b2-9d97-118b83b616dd', '531ceb31-6aab-4172-95cb-5e4fc556c8c1', '1d9ba33e-1d7e-466c-a42e-9c4dd4645d31', 'f37cd9d2-de54-483b-81e9-7e0da70133ac'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:19:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-317aad0b-e1fb-4289-81e0-a750f2127f64 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:19:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-317aad0b-e1fb-4289-81e0-a750f2127f64 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:19:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-317aad0b-e1fb-4289-81e0-a750f2127f64 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:19:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-317aad0b-e1fb-4289-81e0-a750f2127f64 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:19:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-317aad0b-e1fb-4289-81e0-a750f2127f64 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:19:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-317aad0b-e1fb-4289-81e0-a750f2127f64 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-317aad0b-e1fb-4289-81e0-a750f2127f64 tempest-VolumeQuotasNegativeTestJSON-622227092 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.279s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:18 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-317aad0b-e1fb-4289-81e0-a750f2127f64 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:19:18 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-317aad0b-e1fb-4289-81e0-a750f2127f64 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Deleted volume successfully.
Sep 22 23:19:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-317aad0b-e1fb-4289-81e0-a750f2127f64 tempest-VolumeQuotasNegativeTestJSON-622227092 None] Lock "cinder-da0cb5b3-9109-4a6e-b110-185b49720e2d-delete_volume" released by "delete_volume" :: held 3.434s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:19:28 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=10,cinder:UPDATE=7 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:19:28 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=4,cinder:UPDATE=13,cinder:DELETE=2,cinder:INSERT=4 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:19:32 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-9d351bde-2d0c-4cdf-bcda-f955f8c82c11 req-89d66c47-87b1-4f9d-92d5-8b454a9233e0 tempest-AttachVolumeNegativeTest-394912296 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:19:32 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-9d351bde-2d0c-4cdf-bcda-f955f8c82c11 req-89d66c47-87b1-4f9d-92d5-8b454a9233e0 tempest-AttachVolumeNegativeTest-394912296 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:19:32 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-9d351bde-2d0c-4cdf-bcda-f955f8c82c11 req-89d66c47-87b1-4f9d-92d5-8b454a9233e0 tempest-AttachVolumeNegativeTest-394912296 None] Terminate volume connection completed successfully.
Sep 22 23:19:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-9d351bde-2d0c-4cdf-bcda-f955f8c82c11 req-89d66c47-87b1-4f9d-92d5-8b454a9233e0 tempest-AttachVolumeNegativeTest-394912296 None] Deleting attachment d2adb418-afbd-467e-860f-1d7614696262. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:19:36 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:19:36 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:19:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Flow 'volume_create_manager' (e5e94c5b-ce36-4c07-bfcf-72639300ead9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f92a92-fe79-4c8e-8430-b53999a2660f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f92a92-fe79-4c8e-8430-b53999a2660f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-171151023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=356207d3-9c11-4ab3-be39-6790d251cdfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35930431da4e4b3c926123672aeaed38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:19:36Z,use_quota=True,user_id='3b975d1aeb4c44048b333ec5186e14df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0b3c4e-e7af-48af-b057-be8d5ca5b877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0b3c4e-e7af-48af-b057-be8d5ca5b877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabdfe42-bce7-4896-8698-9cbf3149b751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabdfe42-bce7-4896-8698-9cbf3149b751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '356207d3-9c11-4ab3-be39-6790d251cdfa', 'volume_name': 'volume-356207d3-9c11-4ab3-be39-6790d251cdfa', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d8694d-43a9-48cc-aaae-c3e4126e3370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d8694d-43a9-48cc-aaae-c3e4126e3370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e427c473-2ff4-4257-92e3-f9c96cd3f12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:37 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Volume 356207d3-9c11-4ab3-be39-6790d251cdfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-356207d3-9c11-4ab3-be39-6790d251cdfa', 'volume_size': 1}
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-171151023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=356207d3-9c11-4ab3-be39-6790d251cdfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35930431da4e4b3c926123672aeaed38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:19:36Z,use_quota=True,user_id='3b975d1aeb4c44048b333ec5186e14df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Creating volume 356207d3-9c11-4ab3-be39-6790d251cdfa {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:19:37 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-356207d3-9c11-4ab3-be39-6790d251cdfa 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:37 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=31, name=volume-356207d3-9c11-4ab3-be39-6790d251cdfa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-356207d3-9c11-4ab3-be39-6790d251cdfa 1073741824" returned: 0 in 0.522s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-356207d3-9c11-4ab3-be39-6790d251cdfa {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-356207d3-9c11-4ab3-be39-6790d251cdfa" returned: 0 in 0.094s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:38 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] <== create_volume: return (720ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:19:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:19:38 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e427c473-2ff4-4257-92e3-f9c96cd3f12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-356207d3-9c11-4ab3-be39-6790d251cdfa', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:38 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc631806-f461-42c3-bad5-fa0218d55f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:38 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Volume volume-356207d3-9c11-4ab3-be39-6790d251cdfa (356207d3-9c11-4ab3-be39-6790d251cdfa): created successfully
Sep 22 23:19:38 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc631806-f461-42c3-bad5-fa0218d55f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:38 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Flow 'volume_create_manager' (e5e94c5b-ce36-4c07-bfcf-72639300ead9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:19:38 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-83250910-f949-43f9-876a-9a703ab4aa2a tempest-VolumesListAdminTestJSON-1985054808 None] Created volume successfully.
Sep 22 23:19:39 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Flow 'volume_create_manager' (e0a6debb-80a6-41ee-b6c7-4b62083570f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1425672a-83e6-4e8f-a5b9-92de2ce8fde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1425672a-83e6-4e8f-a5b9-92de2ce8fde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-952630346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e49b745-a916-439f-b219-bf18e01740c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35930431da4e4b3c926123672aeaed38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:19:39Z,use_quota=True,user_id='3b975d1aeb4c44048b333ec5186e14df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d688a39-e34c-4a8e-b65f-7487c6232f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d688a39-e34c-4a8e-b65f-7487c6232f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662db7bc-e313-42ab-b6df-4e694e0fde6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662db7bc-e313-42ab-b6df-4e694e0fde6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e49b745-a916-439f-b219-bf18e01740c2', 'volume_name': 'volume-7e49b745-a916-439f-b219-bf18e01740c2', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a133c6f-6eea-4b50-9a53-06de913ec070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a133c6f-6eea-4b50-9a53-06de913ec070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8000f42-33bc-4446-9dfa-6d1e7d34c469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:39 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Volume 7e49b745-a916-439f-b219-bf18e01740c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e49b745-a916-439f-b219-bf18e01740c2', 'volume_size': 1}
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-952630346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e49b745-a916-439f-b219-bf18e01740c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35930431da4e4b3c926123672aeaed38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:19:39Z,use_quota=True,user_id='3b975d1aeb4c44048b333ec5186e14df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Creating volume 7e49b745-a916-439f-b219-bf18e01740c2 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:19:39 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:19:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7e49b745-a916-439f-b219-bf18e01740c2 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:40 devstack quobyte-client[84065]: System call of process 90362 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:19:40 devstack quobyte-client[84065]: System call of process 90362 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:19:40 devstack quobyte-client[84065]: System call of process 90362 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:19:40 devstack quobyte-client[84065]: System call of process 90362 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:19:40 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=32, name=volume-7e49b745-a916-439f-b219-bf18e01740c2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:19:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7e49b745-a916-439f-b219-bf18e01740c2 1073741824" returned: 0 in 0.441s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7e49b745-a916-439f-b219-bf18e01740c2 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7e49b745-a916-439f-b219-bf18e01740c2" returned: 0 in 0.180s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] <== create_volume: return (735ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:19:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:19:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8000f42-33bc-4446-9dfa-6d1e7d34c469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e49b745-a916-439f-b219-bf18e01740c2', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f918dcd6-13c5-437e-8a8b-6879a1708e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:40 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Volume volume-7e49b745-a916-439f-b219-bf18e01740c2 (7e49b745-a916-439f-b219-bf18e01740c2): created successfully
Sep 22 23:19:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f918dcd6-13c5-437e-8a8b-6879a1708e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Flow 'volume_create_manager' (e0a6debb-80a6-41ee-b6c7-4b62083570f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:19:41 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-fcc390bc-d4f7-44af-a36e-54ac863cee07 tempest-VolumesListAdminTestJSON-1985054808 None] Created volume successfully.
Sep 22 23:19:42 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Flow 'volume_create_manager' (871a4a30-e4eb-4897-92e0-34d9d8af70da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e11f1ac1-e7dc-499f-b359-1d1bd45d3cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e11f1ac1-e7dc-499f-b359-1d1bd45d3cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1942022934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f378675-6cbd-4459-9074-3c80b182cf61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35930431da4e4b3c926123672aeaed38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:19:42Z,use_quota=True,user_id='3b975d1aeb4c44048b333ec5186e14df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eefc319e-4914-4052-8d6b-d2742aaa2bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eefc319e-4914-4052-8d6b-d2742aaa2bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af979de7-7bf1-48c5-850e-0371359fe77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af979de7-7bf1-48c5-850e-0371359fe77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f378675-6cbd-4459-9074-3c80b182cf61', 'volume_name': 'volume-0f378675-6cbd-4459-9074-3c80b182cf61', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b19717a-baea-465f-93d2-879595b5d9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b19717a-baea-465f-93d2-879595b5d9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b21ed3a-7d58-4274-96b2-620bdd448eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:42 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Volume 0f378675-6cbd-4459-9074-3c80b182cf61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f378675-6cbd-4459-9074-3c80b182cf61', 'volume_size': 1}
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1942022934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f378675-6cbd-4459-9074-3c80b182cf61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35930431da4e4b3c926123672aeaed38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:19:42Z,use_quota=True,user_id='3b975d1aeb4c44048b333ec5186e14df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Creating volume 0f378675-6cbd-4459-9074-3c80b182cf61 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:19:42 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0f378675-6cbd-4459-9074-3c80b182cf61 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:42 devstack quobyte-client[84065]: System call of process 90367 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:19:42 devstack quobyte-client[84065]: System call of process 90367 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:19:42 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=33, name=volume-0f378675-6cbd-4459-9074-3c80b182cf61, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0f378675-6cbd-4459-9074-3c80b182cf61 1073741824" returned: 0 in 0.448s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0f378675-6cbd-4459-9074-3c80b182cf61 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0f378675-6cbd-4459-9074-3c80b182cf61" returned: 0 in 0.138s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] <== create_volume: return (677ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:19:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:19:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b21ed3a-7d58-4274-96b2-620bdd448eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f378675-6cbd-4459-9074-3c80b182cf61', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91764d26-b808-47a6-9e8f-442b1fd68616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:43 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Volume volume-0f378675-6cbd-4459-9074-3c80b182cf61 (0f378675-6cbd-4459-9074-3c80b182cf61): created successfully
Sep 22 23:19:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91764d26-b808-47a6-9e8f-442b1fd68616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Flow 'volume_create_manager' (871a4a30-e4eb-4897-92e0-34d9d8af70da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:19:43 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-a3b771ba-e03d-46a3-949c-14435028e01e tempest-VolumesListAdminTestJSON-1985054808 None] Created volume successfully.
Sep 22 23:19:45 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:19:45 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:19:45 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Flow 'volume_create_manager' (6a0c2c2d-c0c6-40aa-a353-420d4883c200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6232d511-f06a-4338-a972-b821aef53f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6232d511-f06a-4338-a972-b821aef53f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=246b6a5e-6f8f-4c9b-99d4-ae3016ca048d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8908f3e86544138c491e238d826c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:19:45Z,use_quota=True,user_id='69223d8af9fc457dba7afefb9b13c14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a073ef24-5e6f-41c3-bbe0-b7f40a33cebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a073ef24-5e6f-41c3-bbe0-b7f40a33cebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6acf6d-9a63-46de-8d0b-0eb3b635426a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6acf6d-9a63-46de-8d0b-0eb3b635426a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '246b6a5e-6f8f-4c9b-99d4-ae3016ca048d', 'volume_name': 'volume-246b6a5e-6f8f-4c9b-99d4-ae3016ca048d', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6bca04-5439-4f76-a809-1f231a95d029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6bca04-5439-4f76-a809-1f231a95d029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e97ec9-fdca-4295-baa7-96c6584953ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:46 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Volume 246b6a5e-6f8f-4c9b-99d4-ae3016ca048d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-246b6a5e-6f8f-4c9b-99d4-ae3016ca048d', 'volume_size': 1}
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=246b6a5e-6f8f-4c9b-99d4-ae3016ca048d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8908f3e86544138c491e238d826c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:19:45Z,use_quota=True,user_id='69223d8af9fc457dba7afefb9b13c14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Creating volume 246b6a5e-6f8f-4c9b-99d4-ae3016ca048d {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:19:46 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-246b6a5e-6f8f-4c9b-99d4-ae3016ca048d 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:46 devstack quobyte-client[84065]: System call of process 90380 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:19:46 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=34, name=volume-246b6a5e-6f8f-4c9b-99d4-ae3016ca048d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-246b6a5e-6f8f-4c9b-99d4-ae3016ca048d 1073741824" returned: 0 in 0.688s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-246b6a5e-6f8f-4c9b-99d4-ae3016ca048d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-246b6a5e-6f8f-4c9b-99d4-ae3016ca048d" returned: 0 in 0.178s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] <== create_volume: return (1046ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:19:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:19:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e97ec9-fdca-4295-baa7-96c6584953ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-246b6a5e-6f8f-4c9b-99d4-ae3016ca048d', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99de5c23-4940-4ba9-baa0-598c1e1e59c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:19:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:19:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:19:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:19:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:19:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:19:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:19:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:48 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Volume volume-246b6a5e-6f8f-4c9b-99d4-ae3016ca048d (246b6a5e-6f8f-4c9b-99d4-ae3016ca048d): created successfully
Sep 22 23:19:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99de5c23-4940-4ba9-baa0-598c1e1e59c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:19:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Flow 'volume_create_manager' (6a0c2c2d-c0c6-40aa-a353-420d4883c200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:19:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.765s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:19:48 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-0cea04b2-2c8a-4095-b2a2-c9d0d4b29b28 tempest-VolumesListAdminTestJSON-1056555155 None] Created volume successfully.
Sep 22 23:19:49 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a4e08a8c-17f9-4fb9-9d74-816a3eebdabb tempest-VolumesListAdminTestJSON-1056555155 None] Acquiring lock "cinder-246b6a5e-6f8f-4c9b-99d4-ae3016ca048d-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:19:49 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a4e08a8c-17f9-4fb9-9d74-816a3eebdabb tempest-VolumesListAdminTestJSON-1056555155 None] Lock "cinder-246b6a5e-6f8f-4c9b-99d4-ae3016ca048d-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:19:49 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-a4e08a8c-17f9-4fb9-9d74-816a3eebdabb tempest-VolumesListAdminTestJSON-1056555155 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:19:49 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a4e08a8c-17f9-4fb9-9d74-816a3eebdabb tempest-VolumesListAdminTestJSON-1056555155 None] Acquiring lock "cinder-quobyte-246b6a5e-6f8f-4c9b-99d4-ae3016ca048d" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:19:49 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-badfe2c4-0568-4d35-99c4-389aa862a14e tempest-VolumesListAdminTestJSON-1985054808 None] Acquiring lock "cinder-0f378675-6cbd-4459-9074-3c80b182cf61-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:19:49 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a4e08a8c-17f9-4fb9-9d74-816a3eebdabb tempest-VolumesListAdminTestJSON-1056555155 None] Lock "cinder-quobyte-246b6a5e-6f8f-4c9b-99d4-ae3016ca048d" acquired by "delete_volume" :: waited 0.025s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:19:49 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-badfe2c4-0568-4d35-99c4-389aa862a14e tempest-VolumesListAdminTestJSON-1985054808 None] Lock "cinder-0f378675-6cbd-4459-9074-3c80b182cf61-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:19:49 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5d9e17-af20-487d-85a4-d9016ead242f]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:19:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a4e08a8c-17f9-4fb9-9d74-816a3eebdabb tempest-VolumesListAdminTestJSON-1056555155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-246b6a5e-6f8f-4c9b-99d4-ae3016ca048d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:50 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-badfe2c4-0568-4d35-99c4-389aa862a14e tempest-VolumesListAdminTestJSON-1985054808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:19:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-badfe2c4-0568-4d35-99c4-389aa862a14e tempest-VolumesListAdminTestJSON-1985054808 None] Acquiring lock "cinder-quobyte-0f378675-6cbd-4459-9074-3c80b182cf61" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:19:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-badfe2c4-0568-4d35-99c4-389aa862a14e tempest-VolumesListAdminTestJSON-1985054808 None] Lock "cinder-quobyte-0f378675-6cbd-4459-9074-3c80b182cf61" acquired by "delete_volume" :: waited 0.063s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:19:50 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfef2a9-4eca-4de7-8e17-3c902d81385d]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:19:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-badfe2c4-0568-4d35-99c4-389aa862a14e tempest-VolumesListAdminTestJSON-1985054808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0f378675-6cbd-4459-9074-3c80b182cf61 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:50 devstack quobyte-client[84065]: System call of process 90394 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:19:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a4e08a8c-17f9-4fb9-9d74-816a3eebdabb tempest-VolumesListAdminTestJSON-1056555155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-246b6a5e-6f8f-4c9b-99d4-ae3016ca048d" returned: 0 in 0.948s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a4e08a8c-17f9-4fb9-9d74-816a3eebdabb tempest-VolumesListAdminTestJSON-1056555155 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-246b6a5e-6f8f-4c9b-99d4-ae3016ca048d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a4e08a8c-17f9-4fb9-9d74-816a3eebdabb tempest-VolumesListAdminTestJSON-1056555155 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-246b6a5e-6f8f-4c9b-99d4-ae3016ca048d" returned: 0 in 0.192s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:51 devstack quobyte-client[84065]: System call of process 90395 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:19:51 devstack quobyte-client[84065]: System call of process 90395 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:19:51 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a4e08a8c-17f9-4fb9-9d74-816a3eebdabb tempest-VolumesListAdminTestJSON-1056555155 None] Lock "cinder-quobyte-246b6a5e-6f8f-4c9b-99d4-ae3016ca048d" released by "delete_volume" :: held 1.494s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:19:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-badfe2c4-0568-4d35-99c4-389aa862a14e tempest-VolumesListAdminTestJSON-1985054808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0f378675-6cbd-4459-9074-3c80b182cf61" returned: 0 in 1.013s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-badfe2c4-0568-4d35-99c4-389aa862a14e tempest-VolumesListAdminTestJSON-1985054808 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0f378675-6cbd-4459-9074-3c80b182cf61 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-badfe2c4-0568-4d35-99c4-389aa862a14e tempest-VolumesListAdminTestJSON-1985054808 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0f378675-6cbd-4459-9074-3c80b182cf61" returned: 0 in 0.407s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:51 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-badfe2c4-0568-4d35-99c4-389aa862a14e tempest-VolumesListAdminTestJSON-1985054808 None] Lock "cinder-quobyte-0f378675-6cbd-4459-9074-3c80b182cf61" released by "delete_volume" :: held 1.579s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:19:51 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-a4e08a8c-17f9-4fb9-9d74-816a3eebdabb tempest-VolumesListAdminTestJSON-1056555155 None] Created reservations ['234a4859-826b-42bc-9f9f-5a2f29427b33', '497f5cc8-1db8-4e61-94da-db43364cd703', '74a71d59-e49d-483e-9ca6-8458eb135a85', '7f481cff-4ba1-4d0b-87ce-8b93082f48bc'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:19:52 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-badfe2c4-0568-4d35-99c4-389aa862a14e tempest-VolumesListAdminTestJSON-1985054808 None] Created reservations ['08366ad4-31e7-4913-a2b4-52f55ed829a8', '024a103e-ea66-49ca-b136-5d305fae3703', '7218b895-a477-4cb8-8331-b17fabcbd24e', '5a2c9992-c6dc-4674-ae80-5730b2b82259'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:19:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a4e08a8c-17f9-4fb9-9d74-816a3eebdabb tempest-VolumesListAdminTestJSON-1056555155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:19:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a4e08a8c-17f9-4fb9-9d74-816a3eebdabb tempest-VolumesListAdminTestJSON-1056555155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:19:52 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a4e08a8c-17f9-4fb9-9d74-816a3eebdabb tempest-VolumesListAdminTestJSON-1056555155 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:19:52 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a4e08a8c-17f9-4fb9-9d74-816a3eebdabb tempest-VolumesListAdminTestJSON-1056555155 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:19:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a4e08a8c-17f9-4fb9-9d74-816a3eebdabb tempest-VolumesListAdminTestJSON-1056555155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:19:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a4e08a8c-17f9-4fb9-9d74-816a3eebdabb tempest-VolumesListAdminTestJSON-1056555155 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a4e08a8c-17f9-4fb9-9d74-816a3eebdabb tempest-VolumesListAdminTestJSON-1056555155 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.351s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:52 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-a4e08a8c-17f9-4fb9-9d74-816a3eebdabb tempest-VolumesListAdminTestJSON-1056555155 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:19:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-badfe2c4-0568-4d35-99c4-389aa862a14e tempest-VolumesListAdminTestJSON-1985054808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:19:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-badfe2c4-0568-4d35-99c4-389aa862a14e tempest-VolumesListAdminTestJSON-1985054808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:19:52 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-badfe2c4-0568-4d35-99c4-389aa862a14e tempest-VolumesListAdminTestJSON-1985054808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:19:52 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-badfe2c4-0568-4d35-99c4-389aa862a14e tempest-VolumesListAdminTestJSON-1985054808 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:19:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-badfe2c4-0568-4d35-99c4-389aa862a14e tempest-VolumesListAdminTestJSON-1985054808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:19:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-badfe2c4-0568-4d35-99c4-389aa862a14e tempest-VolumesListAdminTestJSON-1985054808 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:52 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-a4e08a8c-17f9-4fb9-9d74-816a3eebdabb tempest-VolumesListAdminTestJSON-1056555155 None] Deleted volume successfully.
Sep 22 23:19:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-badfe2c4-0568-4d35-99c4-389aa862a14e tempest-VolumesListAdminTestJSON-1985054808 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.420s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:53 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-badfe2c4-0568-4d35-99c4-389aa862a14e tempest-VolumesListAdminTestJSON-1985054808 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:19:53 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a4e08a8c-17f9-4fb9-9d74-816a3eebdabb tempest-VolumesListAdminTestJSON-1056555155 None] Lock "cinder-246b6a5e-6f8f-4c9b-99d4-ae3016ca048d-delete_volume" released by "delete_volume" :: held 3.738s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:19:53 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-badfe2c4-0568-4d35-99c4-389aa862a14e tempest-VolumesListAdminTestJSON-1985054808 None] Deleted volume successfully.
Sep 22 23:19:53 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-badfe2c4-0568-4d35-99c4-389aa862a14e tempest-VolumesListAdminTestJSON-1985054808 None] Lock "cinder-0f378675-6cbd-4459-9074-3c80b182cf61-delete_volume" released by "delete_volume" :: held 3.583s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:19:53 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6a0927ae-10ce-49f5-900a-f4d4a918085d tempest-VolumesListAdminTestJSON-1985054808 None] Acquiring lock "cinder-7e49b745-a916-439f-b219-bf18e01740c2-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:19:53 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6a0927ae-10ce-49f5-900a-f4d4a918085d tempest-VolumesListAdminTestJSON-1985054808 None] Lock "cinder-7e49b745-a916-439f-b219-bf18e01740c2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:19:53 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-6a0927ae-10ce-49f5-900a-f4d4a918085d tempest-VolumesListAdminTestJSON-1985054808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:19:53 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6a0927ae-10ce-49f5-900a-f4d4a918085d tempest-VolumesListAdminTestJSON-1985054808 None] Acquiring lock "cinder-quobyte-7e49b745-a916-439f-b219-bf18e01740c2" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:19:53 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6a0927ae-10ce-49f5-900a-f4d4a918085d tempest-VolumesListAdminTestJSON-1985054808 None] Lock "cinder-quobyte-7e49b745-a916-439f-b219-bf18e01740c2" acquired by "delete_volume" :: waited 0.016s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:19:53 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fc60d4-27ac-4222-84d5-a1ead1e283cf]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:19:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6a0927ae-10ce-49f5-900a-f4d4a918085d tempest-VolumesListAdminTestJSON-1985054808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7e49b745-a916-439f-b219-bf18e01740c2 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:54 devstack quobyte-client[84065]: System call of process 90409 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:19:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6a0927ae-10ce-49f5-900a-f4d4a918085d tempest-VolumesListAdminTestJSON-1985054808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7e49b745-a916-439f-b219-bf18e01740c2" returned: 0 in 0.546s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6a0927ae-10ce-49f5-900a-f4d4a918085d tempest-VolumesListAdminTestJSON-1985054808 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7e49b745-a916-439f-b219-bf18e01740c2 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6a0927ae-10ce-49f5-900a-f4d4a918085d tempest-VolumesListAdminTestJSON-1985054808 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7e49b745-a916-439f-b219-bf18e01740c2" returned: 0 in 0.191s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6a0927ae-10ce-49f5-900a-f4d4a918085d tempest-VolumesListAdminTestJSON-1985054808 None] Lock "cinder-quobyte-7e49b745-a916-439f-b219-bf18e01740c2" released by "delete_volume" :: held 1.102s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:19:55 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-6a0927ae-10ce-49f5-900a-f4d4a918085d tempest-VolumesListAdminTestJSON-1985054808 None] Created reservations ['10ab3aba-df8b-4f38-9f02-91a29e33277e', '14a94f20-4ce6-4496-b8b0-5b0d1f88aa83', '0c7e945a-c5f4-4b86-983e-3e3f78d1ec79', '6315822c-de89-41eb-8674-1460ccd55744'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:19:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6a0927ae-10ce-49f5-900a-f4d4a918085d tempest-VolumesListAdminTestJSON-1985054808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:19:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6a0927ae-10ce-49f5-900a-f4d4a918085d tempest-VolumesListAdminTestJSON-1985054808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:19:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6a0927ae-10ce-49f5-900a-f4d4a918085d tempest-VolumesListAdminTestJSON-1985054808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:19:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6a0927ae-10ce-49f5-900a-f4d4a918085d tempest-VolumesListAdminTestJSON-1985054808 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:19:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6a0927ae-10ce-49f5-900a-f4d4a918085d tempest-VolumesListAdminTestJSON-1985054808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:19:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6a0927ae-10ce-49f5-900a-f4d4a918085d tempest-VolumesListAdminTestJSON-1985054808 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6a0927ae-10ce-49f5-900a-f4d4a918085d tempest-VolumesListAdminTestJSON-1985054808 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.133s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:55 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-6a0927ae-10ce-49f5-900a-f4d4a918085d tempest-VolumesListAdminTestJSON-1985054808 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:19:55 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-6a0927ae-10ce-49f5-900a-f4d4a918085d tempest-VolumesListAdminTestJSON-1985054808 None] Deleted volume successfully.
Sep 22 23:19:56 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6a0927ae-10ce-49f5-900a-f4d4a918085d tempest-VolumesListAdminTestJSON-1985054808 None] Lock "cinder-7e49b745-a916-439f-b219-bf18e01740c2-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:19:56 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5533a3f7-dacc-46d0-964a-a1385dd17241 tempest-VolumesListAdminTestJSON-1985054808 None] Acquiring lock "cinder-356207d3-9c11-4ab3-be39-6790d251cdfa-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:19:56 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5533a3f7-dacc-46d0-964a-a1385dd17241 tempest-VolumesListAdminTestJSON-1985054808 None] Lock "cinder-356207d3-9c11-4ab3-be39-6790d251cdfa-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:19:56 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-5533a3f7-dacc-46d0-964a-a1385dd17241 tempest-VolumesListAdminTestJSON-1985054808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:19:56 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5533a3f7-dacc-46d0-964a-a1385dd17241 tempest-VolumesListAdminTestJSON-1985054808 None] Acquiring lock "cinder-quobyte-356207d3-9c11-4ab3-be39-6790d251cdfa" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:19:56 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5533a3f7-dacc-46d0-964a-a1385dd17241 tempest-VolumesListAdminTestJSON-1985054808 None] Lock "cinder-quobyte-356207d3-9c11-4ab3-be39-6790d251cdfa" acquired by "delete_volume" :: waited 0.012s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:19:56 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57beca0-42f7-4371-ab5d-490a7e753243]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:19:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5533a3f7-dacc-46d0-964a-a1385dd17241 tempest-VolumesListAdminTestJSON-1985054808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-356207d3-9c11-4ab3-be39-6790d251cdfa {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:57 devstack quobyte-client[84065]: System call of process 90434 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:19:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5533a3f7-dacc-46d0-964a-a1385dd17241 tempest-VolumesListAdminTestJSON-1985054808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-356207d3-9c11-4ab3-be39-6790d251cdfa" returned: 0 in 1.104s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5533a3f7-dacc-46d0-964a-a1385dd17241 tempest-VolumesListAdminTestJSON-1985054808 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-356207d3-9c11-4ab3-be39-6790d251cdfa {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:19:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5533a3f7-dacc-46d0-964a-a1385dd17241 tempest-VolumesListAdminTestJSON-1985054808 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-356207d3-9c11-4ab3-be39-6790d251cdfa" returned: 0 in 0.203s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:19:58 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5533a3f7-dacc-46d0-964a-a1385dd17241 tempest-VolumesListAdminTestJSON-1985054808 None] Lock "cinder-quobyte-356207d3-9c11-4ab3-be39-6790d251cdfa" released by "delete_volume" :: held 1.957s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:19:59 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-5533a3f7-dacc-46d0-964a-a1385dd17241 tempest-VolumesListAdminTestJSON-1985054808 None] Created reservations ['9fc6a973-8216-471c-94b4-6aeef7369e9e', '8cb94dc3-c143-4970-bbc7-cdf1d60d5453', 'ec993934-f4b8-4ac8-bc3d-fab41e2b26f3', '1feb8eeb-ba5a-4f8d-9178-b32c712e9176'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:19:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5533a3f7-dacc-46d0-964a-a1385dd17241 tempest-VolumesListAdminTestJSON-1985054808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:19:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5533a3f7-dacc-46d0-964a-a1385dd17241 tempest-VolumesListAdminTestJSON-1985054808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:19:59 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5533a3f7-dacc-46d0-964a-a1385dd17241 tempest-VolumesListAdminTestJSON-1985054808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:19:59 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5533a3f7-dacc-46d0-964a-a1385dd17241 tempest-VolumesListAdminTestJSON-1985054808 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:19:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5533a3f7-dacc-46d0-964a-a1385dd17241 tempest-VolumesListAdminTestJSON-1985054808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:19:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5533a3f7-dacc-46d0-964a-a1385dd17241 tempest-VolumesListAdminTestJSON-1985054808 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:20:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5533a3f7-dacc-46d0-964a-a1385dd17241 tempest-VolumesListAdminTestJSON-1985054808 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.171s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:20:00 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-5533a3f7-dacc-46d0-964a-a1385dd17241 tempest-VolumesListAdminTestJSON-1985054808 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:20:00 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-5533a3f7-dacc-46d0-964a-a1385dd17241 tempest-VolumesListAdminTestJSON-1985054808 None] Deleted volume successfully.
Sep 22 23:20:00 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5533a3f7-dacc-46d0-964a-a1385dd17241 tempest-VolumesListAdminTestJSON-1985054808 None] Lock "cinder-356207d3-9c11-4ab3-be39-6790d251cdfa-delete_volume" released by "delete_volume" :: held 4.395s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:20:09 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=30,cinder:DELETE=4,cinder:UPDATE=36,cinder:INSERT=9 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:20:10 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=20,cinder:UPDATE=44,cinder:INSERT=7,cinder:DELETE=4 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:20:12 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:20:12 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:20:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Flow 'volume_create_manager' (3528d590-dfa3-41a1-a2be-97944f903673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:20:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc8f90c-6287-423b-b1e3-8975e57ca3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:20:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc8f90c-6287-423b-b1e3-8975e57ca3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2058057383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39ae5b9a-917a-4bfb-98c3-32e86dd60fd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60e1e4f57ed4acfac1b8dd7933d33a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:20:13Z,use_quota=True,user_id='73a0515551574870960b13bf846ba9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:20:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4629c64c-2055-44c1-bc4b-3bbf97dc7e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:20:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4629c64c-2055-44c1-bc4b-3bbf97dc7e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:20:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235701a1-2c49-434e-9b8f-c05cc6661c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:20:13 devstack cinder-volume[84012]: DEBUG cinder.image.glance [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Creating Keystone auth plugin from conf {{(pid=84012) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 22 23:20:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235701a1-2c49-434e-9b8f-c05cc6661c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '39ae5b9a-917a-4bfb-98c3-32e86dd60fd3', 'volume_name': 'volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3', 'volume_size': 1, 'image_id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b1f99fd8595b4e59a87b2ac5fd8513ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'created_at': datetime.datetime(2025, 9, 22, 20, 57, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 20, 57, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0d0f84ae00>}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:20:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89353e5b-d824-4cb8-92a4-7cc58d577003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:20:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89353e5b-d824-4cb8-92a4-7cc58d577003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:20:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44f993a-3993-4428-be66-806d755e1486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:20:14 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Volume 39ae5b9a-917a-4bfb-98c3-32e86dd60fd3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3', 'volume_size': 1, 'image_id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b1f99fd8595b4e59a87b2ac5fd8513ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'created_at': datetime.datetime(2025, 9, 22, 20, 57, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 20, 57, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0d0f84ae00>}
Sep 22 23:20:14 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Cloning 39ae5b9a-917a-4bfb-98c3-32e86dd60fd3 from image 60f4d0ec-ef65-4fa8-9530-b89728f917ec  at location (None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}]). {{(pid=84012) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 22 23:20:15 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_uwpxa3f3devstack@QuobyteHD, size 20.69 MB, duration 1.22 sec {{(pid=84012) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 22 23:20:15 devstack cinder-volume[84012]: INFO cinder.image.image_utils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Image download 20.69 MB at 16.99 MB/s
Sep 22 23:20:15 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[049646b7-31cf-4bde-a968-89ff2f765979]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:20:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_uwpxa3f3devstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:20:15 devstack sudo[90557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_uwpxa3f3devstack@QuobyteHD
Sep 22 23:20:15 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:20:20 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root
Sep 22 23:20:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_uwpxa3f3devstack@QuobyteHD" returned: 0 in 5.295s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:20:20 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Temporary image 60f4d0ec-ef65-4fa8-9530-b89728f917ec is fetched for user 73a0515551574870960b13bf846ba9bb. {{(pid=84012) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 22 23:20:22 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ebd694-1531-43fd-87a3-63a2b9def97f]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:20:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_uwpxa3f3devstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:20:24 devstack sudo[90622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_uwpxa3f3devstack@QuobyteHD
Sep 22 23:20:24 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:20:29 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root
Sep 22 23:20:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_uwpxa3f3devstack@QuobyteHD" returned: 0 in 7.015s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:20:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:20:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:20:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2058057383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39ae5b9a-917a-4bfb-98c3-32e86dd60fd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60e1e4f57ed4acfac1b8dd7933d33a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:20:13Z,use_quota=True,user_id='73a0515551574870960b13bf846ba9bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:20:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Creating volume 39ae5b9a-917a-4bfb-98c3-32e86dd60fd3 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:20:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:20:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:20:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:20:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:20:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:20:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:20:29 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:20:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:20:29 devstack quobyte-client[84065]: System call of process 90648 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:20:29 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=35, name=volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:20:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3 1073741824" returned: 0 in 0.396s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:20:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:20:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3" returned: 0 in 0.121s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:20:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] <== create_volume: return (626ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:20:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.660s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:20:30 devstack cinder-volume[84012]: DEBUG cinder.volume.volume_utils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Attempting download of 60f4d0ec-ef65-4fa8-9530-b89728f917ec ((None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}])) to volume 39ae5b9a-917a-4bfb-98c3-32e86dd60fd3. {{(pid=84012) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 22 23:20:30 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a43ed4-59b1-4627-a969-7242d749d2a5]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:20:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60f4d0ec-ef65-4fa8-9530-b89728f917ec_wo542g6s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:20:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60f4d0ec-ef65-4fa8-9530-b89728f917ec_wo542g6s" returned: 0 in 0.657s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:20:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60f4d0ec-ef65-4fa8-9530-b89728f917ec_wo542g6s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:20:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60f4d0ec-ef65-4fa8-9530-b89728f917ec_wo542g6s" returned: 1 in 0.824s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:20:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60f4d0ec-ef65-4fa8-9530-b89728f917ec_wo542g6s' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:20:32 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[604c7870-fef0-42ad-a85c-e1eab4e83f70]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:20:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_uwpxa3f3devstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:20:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_uwpxa3f3devstack@QuobyteHD" returned: 0 in 0.922s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:20:33 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] 60f4d0ec-ef65-4fa8-9530-b89728f917ec was qcow2, converting to raw {{(pid=84012) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 22 23:20:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_uwpxa3f3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:20:34 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=35, name=volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:20:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_uwpxa3f3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3" returned: 0 in 3.208s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:20:36 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_uwpxa3f3devstack@QuobyteHD, size 112.00 MB, duration 3.38 sec, destination /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3 {{(pid=84012) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 22 23:20:36 devstack cinder-volume[84012]: INFO cinder.image.image_utils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Converted 112.00 MB image at 33.09 MB/s
Sep 22 23:20:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:20:37 devstack quobyte-client[84065]: System call of process 90676 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:20:37 devstack quobyte-client[84065]: System call of process 90676 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:20:37 devstack quobyte-client[84065]: System call of process 90676 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:20:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3 1G" returned: 0 in 0.641s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:20:37 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9d83c8-3f76-43ee-a8a7-2ca9b0ababf7]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:20:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:20:39 devstack quobyte-client[84065]: System call of process 90682 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:20:39 devstack quobyte-client[84065]: System call of process 90682 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:20:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3" returned: 0 in 1.397s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:20:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:20:40 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:20:40 devstack quobyte-client[84065]: System call of process 90688 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:20:40 devstack quobyte-client[84065]: System call of process 90688 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:20:40 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:20:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3" returned: 1 in 1.348s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:20:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:20:40 devstack cinder-volume[84012]: DEBUG cinder.volume.volume_utils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Downloaded image 60f4d0ec-ef65-4fa8-9530-b89728f917ec ((None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}])) to volume 39ae5b9a-917a-4bfb-98c3-32e86dd60fd3 successfully. {{(pid=84012) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 22 23:20:40 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Temporary image 60f4d0ec-ef65-4fa8-9530-b89728f917ec for user 73a0515551574870960b13bf846ba9bb is deleted. {{(pid=84012) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 22 23:20:40 devstack cinder-volume[84012]: DEBUG cinder.volume.volume_utils [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Marking volume 39ae5b9a-917a-4bfb-98c3-32e86dd60fd3 as bootable. {{(pid=84012) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 22 23:20:41 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Copying metadata from image 60f4d0ec-ef65-4fa8-9530-b89728f917ec to 39ae5b9a-917a-4bfb-98c3-32e86dd60fd3. {{(pid=84012) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 22 23:20:41 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Creating volume glance metadata for volume 39ae5b9a-917a-4bfb-98c3-32e86dd60fd3 backed by image 60f4d0ec-ef65-4fa8-9530-b89728f917ec with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84012) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 22 23:20:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44f993a-3993-4428-be66-806d755e1486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3', 'volume_size': 1, 'image_id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b1f99fd8595b4e59a87b2ac5fd8513ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'created_at': datetime.datetime(2025, 9, 22, 20, 57, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 20, 57, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0d0f84ae00>}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:20:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143f3701-3975-44c4-808c-22732c8acfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:20:42 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Volume volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3 (39ae5b9a-917a-4bfb-98c3-32e86dd60fd3): created successfully
Sep 22 23:20:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143f3701-3975-44c4-808c-22732c8acfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:20:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Flow 'volume_create_manager' (3528d590-dfa3-41a1-a2be-97944f903673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:20:42 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-d2ae748c-daf4-4969-80fd-07439dd4e2f8 tempest-VolumesImageMetadata-291876629 None] Created volume successfully.
Sep 22 23:20:43 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] Acquiring lock "cinder-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:20:44 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] Lock "cinder-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:20:44 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:20:44 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] Acquiring lock "cinder-quobyte-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:20:44 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] Lock "cinder-quobyte-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3" acquired by "delete_volume" :: waited 0.026s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:20:44 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5b790a-f43b-41d7-b733-34d9289d66b2]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:20:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:20:44 devstack quobyte-client[84065]: System call of process 90724 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:20:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3" returned: 0 in 0.644s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:20:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:20:45 devstack quobyte-client[84065]: System call of process 90726 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:20:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3" returned: 1 in 0.648s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:20:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:20:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:20:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3" returned: 0 in 0.134s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:20:45 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] Lock "cinder-quobyte-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3" released by "delete_volume" :: held 1.770s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:20:46 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] Created reservations ['15d2adbf-b965-438d-882d-e9169128c936', '2ec3fa6e-240d-4066-a686-227dbb43940a', '3a9743a9-e6d2-4de6-95f1-c2b4b9f87456', '8ea2f827-bcd2-4ea3-9d36-8251e862d780'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:20:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:20:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:20:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:20:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:20:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:20:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:20:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.179s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:20:46 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:20:47 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] Deleted volume successfully.
Sep 22 23:20:47 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-20c59265-ff83-414e-8f63-6af4e11ebcbb tempest-VolumesImageMetadata-291876629 None] Lock "cinder-39ae5b9a-917a-4bfb-98c3-32e86dd60fd3-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:20:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:20:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:20:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:20:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:20:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:20:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:20:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:20:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.337s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:20:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:20:54 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Flow 'volume_create_manager' (8287ad92-784c-43b6-870b-fdb908572662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f550ffc1-3b04-4dfa-87ba-8177401199f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f550ffc1-3b04-4dfa-87ba-8177401199f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1710439728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcbc7e25-57ce-4b40-9bf6-be7775751913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cac9d65174d64a1d81aeb13419b84d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:20:54Z,use_quota=True,user_id='832154c9c7984002b107b52ec21ebdc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0196a0a-904f-4522-9c95-068e3c930e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0196a0a-904f-4522-9c95-068e3c930e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e67ca6-b246-49d9-a7db-a841dde54f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e67ca6-b246-49d9-a7db-a841dde54f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcbc7e25-57ce-4b40-9bf6-be7775751913', 'volume_name': 'volume-dcbc7e25-57ce-4b40-9bf6-be7775751913', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60866c1-7a3b-4a2f-99b6-d7668db1a523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60866c1-7a3b-4a2f-99b6-d7668db1a523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf57c8b7-d36a-4d1a-a32d-b5a80ec6638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:20:54 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Volume dcbc7e25-57ce-4b40-9bf6-be7775751913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcbc7e25-57ce-4b40-9bf6-be7775751913', 'volume_size': 1}
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1710439728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcbc7e25-57ce-4b40-9bf6-be7775751913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cac9d65174d64a1d81aeb13419b84d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:20:54Z,use_quota=True,user_id='832154c9c7984002b107b52ec21ebdc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Creating volume dcbc7e25-57ce-4b40-9bf6-be7775751913 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:20:54 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:20:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-dcbc7e25-57ce-4b40-9bf6-be7775751913 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:20:54 devstack quobyte-client[84065]: System call of process 90735 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:20:54 devstack quobyte-client[84065]: System call of process 90735 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:20:54 devstack quobyte-client[84065]: System call of process 90735 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:20:54 devstack quobyte-client[84065]: System call of process 90735 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:20:54 devstack quobyte-client[84065]: System call of process 90735 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:20:54 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=36, name=volume-dcbc7e25-57ce-4b40-9bf6-be7775751913, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:20:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-dcbc7e25-57ce-4b40-9bf6-be7775751913 1073741824" returned: 0 in 0.741s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:20:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-dcbc7e25-57ce-4b40-9bf6-be7775751913 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:20:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-dcbc7e25-57ce-4b40-9bf6-be7775751913" returned: 0 in 0.107s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:20:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] <== create_volume: return (933ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:20:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:20:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf57c8b7-d36a-4d1a-a32d-b5a80ec6638a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcbc7e25-57ce-4b40-9bf6-be7775751913', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:20:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b1af45-7541-46ff-9566-aa67f00bcb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:20:55 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Volume volume-dcbc7e25-57ce-4b40-9bf6-be7775751913 (dcbc7e25-57ce-4b40-9bf6-be7775751913): created successfully
Sep 22 23:20:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b1af45-7541-46ff-9566-aa67f00bcb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:20:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Flow 'volume_create_manager' (8287ad92-784c-43b6-870b-fdb908572662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:20:55 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-3c92adb7-6d2e-42fd-9955-1860ec0e76e8 tempest-VolumesTransfersTest-529129751 None] Created volume successfully.
Sep 22 23:20:56 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-cb2a96b4-70be-4a31-a3dc-de7882617f02 tempest-VolumesTransfersTest-828534642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:20:56 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-cb2a96b4-70be-4a31-a3dc-de7882617f02 tempest-VolumesTransfersTest-828534642 None] Transfer volume completed successfully.
Sep 22 23:20:58 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a93d8bfe-5b2c-4c56-aeeb-e1e0e13a7556 tempest-VolumesTransfersTest-787614634 None] Acquiring lock "cinder-dcbc7e25-57ce-4b40-9bf6-be7775751913-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:20:58 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a93d8bfe-5b2c-4c56-aeeb-e1e0e13a7556 tempest-VolumesTransfersTest-787614634 None] Lock "cinder-dcbc7e25-57ce-4b40-9bf6-be7775751913-delete_volume" acquired by "delete_volume" :: waited 0.181s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:20:58 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-a93d8bfe-5b2c-4c56-aeeb-e1e0e13a7556 tempest-VolumesTransfersTest-787614634 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:20:58 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a93d8bfe-5b2c-4c56-aeeb-e1e0e13a7556 tempest-VolumesTransfersTest-787614634 None] Acquiring lock "cinder-quobyte-dcbc7e25-57ce-4b40-9bf6-be7775751913" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:20:58 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a93d8bfe-5b2c-4c56-aeeb-e1e0e13a7556 tempest-VolumesTransfersTest-787614634 None] Lock "cinder-quobyte-dcbc7e25-57ce-4b40-9bf6-be7775751913" acquired by "delete_volume" :: waited 0.031s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:20:58 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66f77cf-3592-4f16-887a-c41c1a1c09b5]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:20:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93d8bfe-5b2c-4c56-aeeb-e1e0e13a7556 tempest-VolumesTransfersTest-787614634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-dcbc7e25-57ce-4b40-9bf6-be7775751913 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:20:59 devstack quobyte-client[84065]: System call of process 90749 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:20:59 devstack quobyte-client[84065]: System call of process 90749 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:20:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93d8bfe-5b2c-4c56-aeeb-e1e0e13a7556 tempest-VolumesTransfersTest-787614634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-dcbc7e25-57ce-4b40-9bf6-be7775751913" returned: 0 in 0.645s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:20:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93d8bfe-5b2c-4c56-aeeb-e1e0e13a7556 tempest-VolumesTransfersTest-787614634 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-dcbc7e25-57ce-4b40-9bf6-be7775751913 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:20:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93d8bfe-5b2c-4c56-aeeb-e1e0e13a7556 tempest-VolumesTransfersTest-787614634 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-dcbc7e25-57ce-4b40-9bf6-be7775751913" returned: 0 in 0.166s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:20:59 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a93d8bfe-5b2c-4c56-aeeb-e1e0e13a7556 tempest-VolumesTransfersTest-787614634 None] Lock "cinder-quobyte-dcbc7e25-57ce-4b40-9bf6-be7775751913" released by "delete_volume" :: held 1.105s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:20:59 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-a93d8bfe-5b2c-4c56-aeeb-e1e0e13a7556 tempest-VolumesTransfersTest-787614634 None] Created reservations ['69ca63dd-e77c-43d8-9d9a-7bec94147c32', '5382cbff-5fbd-4efe-858c-e3caaebb7b27', '74e2d7ff-059c-4fe3-a6a7-2d37875c9f4e', '65227d9e-7a6a-4fbf-b2fb-1143e9630b14'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:21:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a93d8bfe-5b2c-4c56-aeeb-e1e0e13a7556 tempest-VolumesTransfersTest-787614634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:21:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a93d8bfe-5b2c-4c56-aeeb-e1e0e13a7556 tempest-VolumesTransfersTest-787614634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:21:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a93d8bfe-5b2c-4c56-aeeb-e1e0e13a7556 tempest-VolumesTransfersTest-787614634 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:21:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a93d8bfe-5b2c-4c56-aeeb-e1e0e13a7556 tempest-VolumesTransfersTest-787614634 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:21:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a93d8bfe-5b2c-4c56-aeeb-e1e0e13a7556 tempest-VolumesTransfersTest-787614634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:21:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93d8bfe-5b2c-4c56-aeeb-e1e0e13a7556 tempest-VolumesTransfersTest-787614634 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93d8bfe-5b2c-4c56-aeeb-e1e0e13a7556 tempest-VolumesTransfersTest-787614634 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.151s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:00 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-a93d8bfe-5b2c-4c56-aeeb-e1e0e13a7556 tempest-VolumesTransfersTest-787614634 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:21:00 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-a93d8bfe-5b2c-4c56-aeeb-e1e0e13a7556 tempest-VolumesTransfersTest-787614634 None] Deleted volume successfully.
Sep 22 23:21:00 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a93d8bfe-5b2c-4c56-aeeb-e1e0e13a7556 tempest-VolumesTransfersTest-787614634 None] Lock "cinder-dcbc7e25-57ce-4b40-9bf6-be7775751913-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:21:01 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Flow 'volume_create_manager' (aaadfa67-a892-4784-ad1e-812ba10038de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cce185-45b9-4e83-bbbd-794071d36824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cce185-45b9-4e83-bbbd-794071d36824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-512230803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=548d6f9e-e6b4-4611-b437-bf620a4483f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cac9d65174d64a1d81aeb13419b84d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:21:01Z,use_quota=True,user_id='832154c9c7984002b107b52ec21ebdc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15912d55-7935-42f9-b2e1-ead80860aa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15912d55-7935-42f9-b2e1-ead80860aa8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83bc691a-8d20-475d-993d-ecffa64cf2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83bc691a-8d20-475d-993d-ecffa64cf2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '548d6f9e-e6b4-4611-b437-bf620a4483f7', 'volume_name': 'volume-548d6f9e-e6b4-4611-b437-bf620a4483f7', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9969dca8-06fb-41c5-8c72-534cfaaebe5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9969dca8-06fb-41c5-8c72-534cfaaebe5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d572f432-d29c-4553-86b7-d2c13fa590e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:01 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Volume 548d6f9e-e6b4-4611-b437-bf620a4483f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-548d6f9e-e6b4-4611-b437-bf620a4483f7', 'volume_size': 1}
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-512230803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=548d6f9e-e6b4-4611-b437-bf620a4483f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cac9d65174d64a1d81aeb13419b84d0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:21:01Z,use_quota=True,user_id='832154c9c7984002b107b52ec21ebdc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Creating volume 548d6f9e-e6b4-4611-b437-bf620a4483f7 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:21:01 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:21:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-548d6f9e-e6b4-4611-b437-bf620a4483f7 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:02 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=37, name=volume-548d6f9e-e6b4-4611-b437-bf620a4483f7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:21:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-548d6f9e-e6b4-4611-b437-bf620a4483f7 1073741824" returned: 0 in 0.547s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-548d6f9e-e6b4-4611-b437-bf620a4483f7 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-548d6f9e-e6b4-4611-b437-bf620a4483f7" returned: 0 in 0.154s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:02 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] <== create_volume: return (792ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:21:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:21:03 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d572f432-d29c-4553-86b7-d2c13fa590e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-548d6f9e-e6b4-4611-b437-bf620a4483f7', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:03 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5d4ad6-423f-41a3-933d-f952f70a23ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:03 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Volume volume-548d6f9e-e6b4-4611-b437-bf620a4483f7 (548d6f9e-e6b4-4611-b437-bf620a4483f7): created successfully
Sep 22 23:21:03 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5d4ad6-423f-41a3-933d-f952f70a23ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:03 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Flow 'volume_create_manager' (aaadfa67-a892-4784-ad1e-812ba10038de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:21:03 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-237f8416-8aab-409b-a6e4-ed43dcf66520 tempest-VolumesTransfersTest-529129751 None] Created volume successfully.
Sep 22 23:21:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8f6834a3-c619-43d3-8024-7fba4c6e3bd4 tempest-VolumesTransfersTest-787614634 None] Acquiring lock "cinder-548d6f9e-e6b4-4611-b437-bf620a4483f7-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:21:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8f6834a3-c619-43d3-8024-7fba4c6e3bd4 tempest-VolumesTransfersTest-787614634 None] Lock "cinder-548d6f9e-e6b4-4611-b437-bf620a4483f7-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:21:04 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-8f6834a3-c619-43d3-8024-7fba4c6e3bd4 tempest-VolumesTransfersTest-787614634 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:21:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8f6834a3-c619-43d3-8024-7fba4c6e3bd4 tempest-VolumesTransfersTest-787614634 None] Acquiring lock "cinder-quobyte-548d6f9e-e6b4-4611-b437-bf620a4483f7" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:21:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8f6834a3-c619-43d3-8024-7fba4c6e3bd4 tempest-VolumesTransfersTest-787614634 None] Lock "cinder-quobyte-548d6f9e-e6b4-4611-b437-bf620a4483f7" acquired by "delete_volume" :: waited 0.025s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:21:04 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[337da393-a8b3-4e25-9167-a61eb216ab9d]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:21:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8f6834a3-c619-43d3-8024-7fba4c6e3bd4 tempest-VolumesTransfersTest-787614634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-548d6f9e-e6b4-4611-b437-bf620a4483f7 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:04 devstack quobyte-client[84065]: System call of process 90810 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8f6834a3-c619-43d3-8024-7fba4c6e3bd4 tempest-VolumesTransfersTest-787614634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-548d6f9e-e6b4-4611-b437-bf620a4483f7" returned: 0 in 0.563s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8f6834a3-c619-43d3-8024-7fba4c6e3bd4 tempest-VolumesTransfersTest-787614634 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-548d6f9e-e6b4-4611-b437-bf620a4483f7 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8f6834a3-c619-43d3-8024-7fba4c6e3bd4 tempest-VolumesTransfersTest-787614634 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-548d6f9e-e6b4-4611-b437-bf620a4483f7" returned: 0 in 0.154s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:05 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8f6834a3-c619-43d3-8024-7fba4c6e3bd4 tempest-VolumesTransfersTest-787614634 None] Lock "cinder-quobyte-548d6f9e-e6b4-4611-b437-bf620a4483f7" released by "delete_volume" :: held 0.956s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:21:05 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-8f6834a3-c619-43d3-8024-7fba4c6e3bd4 tempest-VolumesTransfersTest-787614634 None] Created reservations ['f5849f3c-3920-44e8-84f2-be4d66670433', '985ed234-28bd-4a9d-baef-28d91d363d73', '114f15b9-a763-4e28-bde8-7ce840c43b63', '52bfe428-0df1-4b04-98b9-210b77908a80'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:21:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8f6834a3-c619-43d3-8024-7fba4c6e3bd4 tempest-VolumesTransfersTest-787614634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:21:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8f6834a3-c619-43d3-8024-7fba4c6e3bd4 tempest-VolumesTransfersTest-787614634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:21:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-8f6834a3-c619-43d3-8024-7fba4c6e3bd4 tempest-VolumesTransfersTest-787614634 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:21:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-8f6834a3-c619-43d3-8024-7fba4c6e3bd4 tempest-VolumesTransfersTest-787614634 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:21:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8f6834a3-c619-43d3-8024-7fba4c6e3bd4 tempest-VolumesTransfersTest-787614634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:21:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8f6834a3-c619-43d3-8024-7fba4c6e3bd4 tempest-VolumesTransfersTest-787614634 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8f6834a3-c619-43d3-8024-7fba4c6e3bd4 tempest-VolumesTransfersTest-787614634 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.115s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:06 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-8f6834a3-c619-43d3-8024-7fba4c6e3bd4 tempest-VolumesTransfersTest-787614634 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:21:06 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-8f6834a3-c619-43d3-8024-7fba4c6e3bd4 tempest-VolumesTransfersTest-787614634 None] Deleted volume successfully.
Sep 22 23:21:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8f6834a3-c619-43d3-8024-7fba4c6e3bd4 tempest-VolumesTransfersTest-787614634 None] Lock "cinder-548d6f9e-e6b4-4611-b437-bf620a4483f7-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:21:15 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=25,cinder:INSERT=9,cinder:UPDATE=37,cinder:DELETE=5 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:21:15 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Flow 'volume_create_manager' (2dbaef5b-4f6f-4375-b79f-fc97f114b572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ebe5efd-1a72-44f7-9553-5ee7a9bfd0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:16 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Flow 'volume_create_manager' (d22085d4-c949-42f5-8909-d897be73e212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366c6492-805e-48fd-a642-f3a9bb7c8477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ebe5efd-1a72-44f7-9553-5ee7a9bfd0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1096018369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8ecaef-441b-46cd-9598-1be73635c83d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f68ad47e2234dc6a4a1d26431b3ade3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:21:16Z,use_quota=True,user_id='66f61eabde72447084620e13cb3fa1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6692a62e-bcde-43c8-bfdc-8d0a467e2b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6692a62e-bcde-43c8-bfdc-8d0a467e2b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8cbeb27-71df-48ef-bd21-e13279e7ef72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8cbeb27-71df-48ef-bd21-e13279e7ef72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b8ecaef-441b-46cd-9598-1be73635c83d', 'volume_name': 'volume-3b8ecaef-441b-46cd-9598-1be73635c83d', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92db03ce-8a9b-42d2-a9ef-179d25a90f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92db03ce-8a9b-42d2-a9ef-179d25a90f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94bcd321-6591-4784-8749-afdebb8ffb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:16 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Volume 3b8ecaef-441b-46cd-9598-1be73635c83d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b8ecaef-441b-46cd-9598-1be73635c83d', 'volume_size': 1}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1096018369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8ecaef-441b-46cd-9598-1be73635c83d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f68ad47e2234dc6a4a1d26431b3ade3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:21:16Z,use_quota=True,user_id='66f61eabde72447084620e13cb3fa1d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Creating volume 3b8ecaef-441b-46cd-9598-1be73635c83d {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:21:16 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:21:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3b8ecaef-441b-46cd-9598-1be73635c83d 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:16 devstack quobyte-client[84065]: System call of process 90858 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:16 devstack quobyte-client[84065]: System call of process 90858 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:16 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=38, name=volume-3b8ecaef-441b-46cd-9598-1be73635c83d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:21:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366c6492-805e-48fd-a642-f3a9bb7c8477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1399659629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2dc8b0a-4312-47b4-8fc4-586459c87eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc94a5c733344ca8034ee38f3949b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:21:16Z,use_quota=True,user_id='e53c3c19bc7a458cba5fcd2d956e2ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7606310a-8c1e-47cd-923a-f97ec77062ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7606310a-8c1e-47cd-923a-f97ec77062ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9cfb83-896b-4ee1-8281-204d874731d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:17 devstack cinder-volume[84012]: DEBUG cinder.image.glance [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Creating Keystone auth plugin from conf {{(pid=84012) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 22 23:21:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3b8ecaef-441b-46cd-9598-1be73635c83d 1073741824" returned: 0 in 0.918s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3b8ecaef-441b-46cd-9598-1be73635c83d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3b8ecaef-441b-46cd-9598-1be73635c83d" returned: 0 in 0.108s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] <== create_volume: return (1110ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:21:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:21:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94bcd321-6591-4784-8749-afdebb8ffb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b8ecaef-441b-46cd-9598-1be73635c83d', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4ecea0-191d-4b5f-adde-504898b4944c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:17 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Volume volume-3b8ecaef-441b-46cd-9598-1be73635c83d (3b8ecaef-441b-46cd-9598-1be73635c83d): created successfully
Sep 22 23:21:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4ecea0-191d-4b5f-adde-504898b4944c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Flow 'volume_create_manager' (2dbaef5b-4f6f-4375-b79f-fc97f114b572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:21:17 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-6f4b0870-551c-4a2c-ab3e-d3e55b845a55 tempest-AttachVolumeShelveTestJSON-1091243525 None] Created volume successfully.
Sep 22 23:21:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9cfb83-896b-4ee1-8281-204d874731d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c2dc8b0a-4312-47b4-8fc4-586459c87eb8', 'volume_name': 'volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8', 'volume_size': 1, 'image_id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b1f99fd8595b4e59a87b2ac5fd8513ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'created_at': datetime.datetime(2025, 9, 22, 20, 57, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 20, 57, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0d0f95c400>}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc55115-6574-46f9-aa71-aec93f8ca3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc55115-6574-46f9-aa71-aec93f8ca3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49cd597b-7ed7-4080-ad3a-aacec3ec9814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:17 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Volume c2dc8b0a-4312-47b4-8fc4-586459c87eb8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8', 'volume_size': 1, 'image_id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b1f99fd8595b4e59a87b2ac5fd8513ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'created_at': datetime.datetime(2025, 9, 22, 20, 57, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 20, 57, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0d0f95c400>}
Sep 22 23:21:17 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Cloning c2dc8b0a-4312-47b4-8fc4-586459c87eb8 from image 60f4d0ec-ef65-4fa8-9530-b89728f917ec  at location (None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}]). {{(pid=84012) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 22 23:21:18 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_4wm6_594devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84012) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 22 23:21:18 devstack cinder-volume[84012]: INFO cinder.image.image_utils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Image download 20.69 MB at 20.69 MB/s
Sep 22 23:21:18 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[579fdf8e-c4d3-4ff8-927f-a88094990380]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:21:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_4wm6_594devstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:19 devstack sudo[90866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_4wm6_594devstack@QuobyteHD
Sep 22 23:21:19 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:21:21 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root
Sep 22 23:21:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_4wm6_594devstack@QuobyteHD" returned: 0 in 3.348s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:22 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Temporary image 60f4d0ec-ef65-4fa8-9530-b89728f917ec is fetched for user e53c3c19bc7a458cba5fcd2d956e2ea1. {{(pid=84012) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 22 23:21:22 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0faebe4-d247-4129-95dc-9e337d0a0f68]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:21:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_4wm6_594devstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:24 devstack sudo[90874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_4wm6_594devstack@QuobyteHD
Sep 22 23:21:24 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:21:30 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root
Sep 22 23:21:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_4wm6_594devstack@QuobyteHD" returned: 0 in 7.259s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:21:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:21:30 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1399659629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2dc8b0a-4312-47b4-8fc4-586459c87eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc94a5c733344ca8034ee38f3949b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:21:16Z,use_quota=True,user_id='e53c3c19bc7a458cba5fcd2d956e2ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:21:30 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Creating volume c2dc8b0a-4312-47b4-8fc4-586459c87eb8 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:21:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:21:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:21:30 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:21:30 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:21:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:21:30 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:21:30 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:21:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:30 devstack quobyte-client[84065]: System call of process 90953 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:30 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=39, name=volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:21:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8 1073741824" returned: 0 in 0.542s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8" returned: 0 in 0.186s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:31 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] <== create_volume: return (939ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:21:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:21:31 devstack cinder-volume[84012]: DEBUG cinder.volume.volume_utils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Attempting download of 60f4d0ec-ef65-4fa8-9530-b89728f917ec ((None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}])) to volume c2dc8b0a-4312-47b4-8fc4-586459c87eb8. {{(pid=84012) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 22 23:21:31 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[358ee746-42a2-41f2-9f8b-dd81f25bdb0f]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:21:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60f4d0ec-ef65-4fa8-9530-b89728f917ec_n49l9uk1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60f4d0ec-ef65-4fa8-9530-b89728f917ec_n49l9uk1" returned: 0 in 0.441s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60f4d0ec-ef65-4fa8-9530-b89728f917ec_n49l9uk1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60f4d0ec-ef65-4fa8-9530-b89728f917ec_n49l9uk1" returned: 1 in 0.797s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60f4d0ec-ef65-4fa8-9530-b89728f917ec_n49l9uk1' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:21:33 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf9b20c-f43f-456a-99d8-342a285d1f83]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:21:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_4wm6_594devstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_4wm6_594devstack@QuobyteHD" returned: 0 in 0.516s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:33 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] 60f4d0ec-ef65-4fa8-9530-b89728f917ec was qcow2, converting to raw {{(pid=84012) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 22 23:21:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_4wm6_594devstack@QuobyteHD /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:33 devstack quobyte-client[84065]: System call of process 90968 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:33 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=39, name=volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:21:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_4wm6_594devstack@QuobyteHD /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8" returned: 0 in 1.547s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:35 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_4wm6_594devstack@QuobyteHD, size 112.00 MB, duration 1.61 sec, destination /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8 {{(pid=84012) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 22 23:21:35 devstack cinder-volume[84012]: INFO cinder.image.image_utils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Converted 112.00 MB image at 69.36 MB/s
Sep 22 23:21:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:35 devstack quobyte-client[84065]: System call of process 90975 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8 1G" returned: 0 in 0.191s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:35 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff387d9-e1d6-42cf-83e1-4cec13e8dd5b]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:21:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8" returned: 0 in 0.514s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:36 devstack quobyte-client[84065]: System call of process 90980 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8" returned: 1 in 0.387s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:21:36 devstack cinder-volume[84012]: DEBUG cinder.volume.volume_utils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Downloaded image 60f4d0ec-ef65-4fa8-9530-b89728f917ec ((None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}])) to volume c2dc8b0a-4312-47b4-8fc4-586459c87eb8 successfully. {{(pid=84012) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 22 23:21:36 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Temporary image 60f4d0ec-ef65-4fa8-9530-b89728f917ec for user e53c3c19bc7a458cba5fcd2d956e2ea1 is deleted. {{(pid=84012) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 22 23:21:36 devstack cinder-volume[84012]: DEBUG cinder.volume.volume_utils [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Marking volume c2dc8b0a-4312-47b4-8fc4-586459c87eb8 as bootable. {{(pid=84012) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 22 23:21:36 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Copying metadata from image 60f4d0ec-ef65-4fa8-9530-b89728f917ec to c2dc8b0a-4312-47b4-8fc4-586459c87eb8. {{(pid=84012) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 22 23:21:36 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Creating volume glance metadata for volume c2dc8b0a-4312-47b4-8fc4-586459c87eb8 backed by image 60f4d0ec-ef65-4fa8-9530-b89728f917ec with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84012) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 22 23:21:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49cd597b-7ed7-4080-ad3a-aacec3ec9814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8', 'volume_size': 1, 'image_id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b1f99fd8595b4e59a87b2ac5fd8513ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'created_at': datetime.datetime(2025, 9, 22, 20, 57, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 20, 57, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0d0f95c400>}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d0f8f3-19dc-4ee6-a365-8d74f48c23e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:37 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Volume volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8 (c2dc8b0a-4312-47b4-8fc4-586459c87eb8): created successfully
Sep 22 23:21:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d0f8f3-19dc-4ee6-a365-8d74f48c23e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Flow 'volume_create_manager' (d22085d4-c949-42f5-8909-d897be73e212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:21:37 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-28b79f15-0cf6-4724-aaf6-9ce0a0c213ca tempest-VolumesExtendTest-925783615 None] Created volume successfully.
Sep 22 23:21:37 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-fef5e50d-276c-411a-b785-c5d6f5b9fd80 tempest-VolumesExtendTest-925783615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:21:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fef5e50d-276c-411a-b785-c5d6f5b9fd80 tempest-VolumesExtendTest-925783615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:21:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fef5e50d-276c-411a-b785-c5d6f5b9fd80 tempest-VolumesExtendTest-925783615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:21:37 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fe0de0-0364-4efd-9c69-99988b13cc9a]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:21:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fef5e50d-276c-411a-b785-c5d6f5b9fd80 tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:38 devstack quobyte-client[84065]: System call of process 90983 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:38 devstack quobyte-client[84065]: System call of process 90983 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:38 devstack quobyte-client[84065]: System call of process 90983 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fef5e50d-276c-411a-b785-c5d6f5b9fd80 tempest-VolumesExtendTest-925783615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8" returned: 0 in 0.584s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fef5e50d-276c-411a-b785-c5d6f5b9fd80 tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:38 devstack quobyte-client[84065]: System call of process 90985 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:38 devstack quobyte-client[84065]: System call of process 90985 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:38 devstack quobyte-client[84065]: System call of process 90985 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fef5e50d-276c-411a-b785-c5d6f5b9fd80 tempest-VolumesExtendTest-925783615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8" returned: 1 in 0.616s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fef5e50d-276c-411a-b785-c5d6f5b9fd80 tempest-VolumesExtendTest-925783615 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:21:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fef5e50d-276c-411a-b785-c5d6f5b9fd80 tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8 2G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:39 devstack quobyte-client[84065]: System call of process 90988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fef5e50d-276c-411a-b785-c5d6f5b9fd80 tempest-VolumesExtendTest-925783615 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8 2G" returned: 0 in 0.176s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fef5e50d-276c-411a-b785-c5d6f5b9fd80 tempest-VolumesExtendTest-925783615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.557s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:21:39 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-fef5e50d-276c-411a-b785-c5d6f5b9fd80 tempest-VolumesExtendTest-925783615 None] Extend volume completed successfully.
Sep 22 23:21:40 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] Acquiring lock "cinder-c2dc8b0a-4312-47b4-8fc4-586459c87eb8-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:21:40 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] Lock "cinder-c2dc8b0a-4312-47b4-8fc4-586459c87eb8-delete_volume" acquired by "delete_volume" :: waited 0.187s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:21:40 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=33,cinder:SELECT=34,cinder:INSERT=23,cinder:DELETE=2 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:21:40 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:21:40 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] Acquiring lock "cinder-quobyte-c2dc8b0a-4312-47b4-8fc4-586459c87eb8" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:21:40 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] Lock "cinder-quobyte-c2dc8b0a-4312-47b4-8fc4-586459c87eb8" acquired by "delete_volume" :: waited 0.018s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:21:41 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed16c903-cf10-4fd5-a6dd-be01caa7ebca]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:21:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:42 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:21:42 devstack quobyte-client[84065]: System call of process 90994 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:42 devstack quobyte-client[84065]: System call of process 90994 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:42 devstack quobyte-client[84065]: System call of process 90994 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Flow 'volume_create_manager' (06d6047d-1e11-4789-95fb-671e8b8a67ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73fcb7a5-5cf9-4da5-aa45-2d9ee340346f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8" returned: 0 in 1.275s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73fcb7a5-5cf9-4da5-aa45-2d9ee340346f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1425733839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3f9b36-a814-40e1-bfec-5322fb16358e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838892ace8b2480cb449321c05f51da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:21:41Z,use_quota=True,user_id='8fd961a280d94838b29811c87cfc65b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2764ac-70f7-4a8d-9c25-989655016de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2764ac-70f7-4a8d-9c25-989655016de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fdd6880-0187-4941-8639-048a9a95d452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fdd6880-0187-4941-8639-048a9a95d452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d3f9b36-a814-40e1-bfec-5322fb16358e', 'volume_name': 'volume-5d3f9b36-a814-40e1-bfec-5322fb16358e', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72feb2f1-c383-4463-bbd3-2dd457569409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72feb2f1-c383-4463-bbd3-2dd457569409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d0147b-0e4e-4948-b3eb-b06be601d73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:42 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Volume 5d3f9b36-a814-40e1-bfec-5322fb16358e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d3f9b36-a814-40e1-bfec-5322fb16358e', 'volume_size': 1}
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1425733839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3f9b36-a814-40e1-bfec-5322fb16358e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838892ace8b2480cb449321c05f51da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:21:41Z,use_quota=True,user_id='8fd961a280d94838b29811c87cfc65b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Creating volume 5d3f9b36-a814-40e1-bfec-5322fb16358e {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:21:42 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:21:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d3f9b36-a814-40e1-bfec-5322fb16358e 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:42 devstack quobyte-client[84065]: System call of process 91000 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:42 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=40, name=volume-5d3f9b36-a814-40e1-bfec-5322fb16358e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:21:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d3f9b36-a814-40e1-bfec-5322fb16358e 1073741824" returned: 0 in 0.557s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d3f9b36-a814-40e1-bfec-5322fb16358e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8" returned: 1 in 1.171s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:21:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d3f9b36-a814-40e1-bfec-5322fb16358e" returned: 0 in 0.310s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] <== create_volume: return (1039ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:21:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:21:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d0147b-0e4e-4948-b3eb-b06be601d73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d3f9b36-a814-40e1-bfec-5322fb16358e', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3539210c-0e52-4a0f-80ab-24b31c62e4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c2dc8b0a-4312-47b4-8fc4-586459c87eb8" returned: 0 in 0.592s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:44 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] Lock "cinder-quobyte-c2dc8b0a-4312-47b4-8fc4-586459c87eb8" released by "delete_volume" :: held 3.293s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:21:44 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Volume volume-5d3f9b36-a814-40e1-bfec-5322fb16358e (5d3f9b36-a814-40e1-bfec-5322fb16358e): created successfully
Sep 22 23:21:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3539210c-0e52-4a0f-80ab-24b31c62e4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Flow 'volume_create_manager' (06d6047d-1e11-4789-95fb-671e8b8a67ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:21:44 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-b1eac3d2-a372-4be0-8d1a-f63fcffcf92a tempest-AttachVolumeNegativeTest-394912296 None] Created volume successfully.
Sep 22 23:21:44 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] Created reservations ['c6ed7fdb-6c24-42cf-9f41-18b66fe7d6aa', 'a1c75a09-5c1f-4320-ba3f-b15dc2156c7e', '42e7fc98-9156-4846-bd48-79efce9adaca', '7085c863-faed-4d0b-ba3d-9a290ff7dbe3'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:21:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:21:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:21:44 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:21:44 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:21:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:21:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.123s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:44 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:21:44 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] Deleted volume successfully.
Sep 22 23:21:45 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e6d902de-d033-4d75-a5fd-f2826214249b tempest-VolumesExtendTest-925783615 None] Lock "cinder-c2dc8b0a-4312-47b4-8fc4-586459c87eb8-delete_volume" released by "delete_volume" :: held 4.359s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:21:45 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-b294c910-8338-4ef5-b21b-0f06e3a8a150 req-5dae0b99-dba1-44ce-a76f-4d8e6e05d69e tempest-AttachVolumeShelveTestJSON-1091243525 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:21:45 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-b294c910-8338-4ef5-b21b-0f06e3a8a150 req-5dae0b99-dba1-44ce-a76f-4d8e6e05d69e tempest-AttachVolumeShelveTestJSON-1091243525 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:21:45 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-b294c910-8338-4ef5-b21b-0f06e3a8a150 req-5dae0b99-dba1-44ce-a76f-4d8e6e05d69e tempest-AttachVolumeShelveTestJSON-1091243525 None] No connector for attachment ca42631c-408d-4cc8-a8f2-3c34f346fc5f; skipping storage backend terminate_connection call. {{(pid=84012) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 22 23:21:45 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-b294c910-8338-4ef5-b21b-0f06e3a8a150 req-5dae0b99-dba1-44ce-a76f-4d8e6e05d69e tempest-AttachVolumeShelveTestJSON-1091243525 None] Deleting attachment ca42631c-408d-4cc8-a8f2-3c34f346fc5f. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:21:46 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Flow 'volume_create_manager' (dfb24668-28dc-48f3-bf70-3843dc8fd698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92588cb6-edd0-4692-b483-f400bb38dd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92588cb6-edd0-4692-b483-f400bb38dd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-503789697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc94a5c733344ca8034ee38f3949b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:21:46Z,use_quota=True,user_id='e53c3c19bc7a458cba5fcd2d956e2ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe7bee2-77e6-4fc7-8ab2-af84419a45d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe7bee2-77e6-4fc7-8ab2-af84419a45d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bba96be-9732-46f9-802f-808aaa637050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bba96be-9732-46f9-802f-808aaa637050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a', 'volume_name': 'volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (849bc123-10f7-40ee-bf24-8537dbc2e22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (849bc123-10f7-40ee-bf24-8537dbc2e22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6c70297-b151-405d-a447-c90f80639346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:46 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Volume 2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a', 'volume_size': 1}
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-503789697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc94a5c733344ca8034ee38f3949b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:21:46Z,use_quota=True,user_id='e53c3c19bc7a458cba5fcd2d956e2ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Creating volume 2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:21:46 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:46 devstack quobyte-client[84065]: System call of process 91010 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:46 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=41, name=volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a 1073741824" returned: 0 in 0.469s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a" returned: 0 in 0.217s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] <== create_volume: return (832ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:21:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:21:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6c70297-b151-405d-a447-c90f80639346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0978bb-6eab-420a-9423-16f68a6f53b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:21:47 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Volume volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a (2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a): created successfully
Sep 22 23:21:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0978bb-6eab-420a-9423-16f68a6f53b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:21:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Flow 'volume_create_manager' (dfb24668-28dc-48f3-bf70-3843dc8fd698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:21:47 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-cf884958-5e2f-4026-b05b-4ddd88a33506 tempest-VolumesExtendTest-925783615 None] Created volume successfully.
Sep 22 23:21:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:21:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:21:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:21:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:21:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:21:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:21:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.200s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:21:48 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:21:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:21:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:21:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] Creating offline snapshot 766c8785-934a-4308-b872-f4ed97a55c5f of volume 2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:21:49 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca5e817-f251-4f86-a017-a572b95f0f92]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:21:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:49 devstack quobyte-client[84065]: System call of process 91022 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:49 devstack quobyte-client[84065]: System call of process 91022 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:49 devstack quobyte-client[84065]: System call of process 91022 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-db520ab4-9bd9-4305-af69-95f29d0d3433 req-c828be49-107b-4c03-89b2-1811e711492f tempest-AttachVolumeNegativeTest-394912296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:21:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a" returned: 0 in 0.974s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.766c8785-934a-4308-b872-f4ed97a55c5f 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:50 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=42, name=volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.766c8785-934a-4308-b872-f4ed97a55c5f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:21:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.766c8785-934a-4308-b872-f4ed97a55c5f 1G" returned: 0 in 0.250s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.766c8785-934a-4308-b872-f4ed97a55c5f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:50 devstack quobyte-client[84065]: System call of process 91029 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] CMD "qemu-img rebase -u -b volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.766c8785-934a-4308-b872-f4ed97a55c5f" returned: 0 in 0.168s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:50 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.766c8785-934a-4308-b872-f4ed97a55c5f is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:21:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.766c8785-934a-4308-b872-f4ed97a55c5f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.766c8785-934a-4308-b872-f4ed97a55c5f" returned: 0 in 0.099s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:50 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:21:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.766c8785-934a-4308-b872-f4ed97a55c5f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.766c8785-934a-4308-b872-f4ed97a55c5f" returned: 0 in 0.111s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.info" returned: 0 in 0.090s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:50 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.info is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:21:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.info" returned: 0 in 0.092s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:21:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-db520ab4-9bd9-4305-af69-95f29d0d3433 req-c828be49-107b-4c03-89b2-1811e711492f tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.198s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:21:51 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf8c020-ac6a-4a47-8ed0-6290c0d7aef7]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:21:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-db520ab4-9bd9-4305-af69-95f29d0d3433 req-c828be49-107b-4c03-89b2-1811e711492f tempest-AttachVolumeNegativeTest-394912296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d3f9b36-a814-40e1-bfec-5322fb16358e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:51 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-a4e3bd58-3bee-4796-be38-4b5119ce782d tempest-VolumesExtendTest-925783615 None] Create snapshot completed successfully
Sep 22 23:21:51 devstack quobyte-client[84065]: System call of process 91036 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-db520ab4-9bd9-4305-af69-95f29d0d3433 req-c828be49-107b-4c03-89b2-1811e711492f tempest-AttachVolumeNegativeTest-394912296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d3f9b36-a814-40e1-bfec-5322fb16358e" returned: 0 in 0.566s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-db520ab4-9bd9-4305-af69-95f29d0d3433 req-c828be49-107b-4c03-89b2-1811e711492f tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.661s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:21:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-db520ab4-9bd9-4305-af69-95f29d0d3433 req-c828be49-107b-4c03-89b2-1811e711492f tempest-AttachVolumeNegativeTest-394912296 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-5d3f9b36-a814-40e1-bfec-5322fb16358e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b1a52dc-2699-4b52-9292-1e248d649de1', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:21:51 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-db520ab4-9bd9-4305-af69-95f29d0d3433 req-c828be49-107b-4c03-89b2-1811e711492f tempest-AttachVolumeNegativeTest-394912296 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:21:52 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-ca415185-9438-4487-b369-3146f0fde935 tempest-VolumesExtendTest-925783615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:21:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ca415185-9438-4487-b369-3146f0fde935 tempest-VolumesExtendTest-925783615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:21:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ca415185-9438-4487-b369-3146f0fde935 tempest-VolumesExtendTest-925783615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:21:52 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb3cc57-1694-41c7-96eb-192e87f008bc]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:21:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ca415185-9438-4487-b369-3146f0fde935 tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:52 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-db520ab4-9bd9-4305-af69-95f29d0d3433 req-c828be49-107b-4c03-89b2-1811e711492f tempest-AttachVolumeNegativeTest-394912296 None] attachment_update completed successfully.
Sep 22 23:21:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ca415185-9438-4487-b369-3146f0fde935 tempest-VolumesExtendTest-925783615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a" returned: 0 in 0.543s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ca415185-9438-4487-b369-3146f0fde935 tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.766c8785-934a-4308-b872-f4ed97a55c5f 2G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:52 devstack quobyte-client[84065]: System call of process 91043 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ca415185-9438-4487-b369-3146f0fde935 tempest-VolumesExtendTest-925783615 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.766c8785-934a-4308-b872-f4ed97a55c5f 2G" returned: 0 in 0.302s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ca415185-9438-4487-b369-3146f0fde935 tempest-VolumesExtendTest-925783615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.036s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:21:53 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-ca415185-9438-4487-b369-3146f0fde935 tempest-VolumesExtendTest-925783615 None] Extend volume completed successfully.
Sep 22 23:21:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] Acquiring lock "cinder-766c8785-934a-4308-b872-f4ed97a55c5f-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:21:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] Lock "cinder-766c8785-934a-4308-b872-f4ed97a55c5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:21:54 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:21:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] Acquiring lock "cinder-quobyte-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:21:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] Lock "cinder-quobyte-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:21:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] Acquiring lock "cinder-quobyte-766c8785-934a-4308-b872-f4ed97a55c5f" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:21:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] Lock "cinder-quobyte-766c8785-934a-4308-b872-f4ed97a55c5f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:21:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] Deleting offline snapshot 766c8785-934a-4308-b872-f4ed97a55c5f of volume 2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:21:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] snapshot_file for this snap is: volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.766c8785-934a-4308-b872-f4ed97a55c5f {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:21:54 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a854e0-7cbf-4031-bf91-36f23e8c2a69]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:21:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.766c8785-934a-4308-b872-f4ed97a55c5f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:55 devstack quobyte-client[84065]: System call of process 91432 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.766c8785-934a-4308-b872-f4ed97a55c5f" returned: 0 in 0.602s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:21:55 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[158cf624-1cee-4d00-a76b-2827ad5a2927]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:21:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:56 devstack quobyte-client[84065]: System call of process 91436 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:56 devstack quobyte-client[84065]: System call of process 91436 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:56 devstack quobyte-client[84065]: System call of process 91436 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:21:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a" returned: 0 in 0.856s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.766c8785-934a-4308-b872-f4ed97a55c5f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.766c8785-934a-4308-b872-f4ed97a55c5f" returned: 0 in 0.499s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.766c8785-934a-4308-b872-f4ed97a55c5f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a.766c8785-934a-4308-b872-f4ed97a55c5f" returned: 0 in 0.172s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:57 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] Lock "cinder-quobyte-766c8785-934a-4308-b872-f4ed97a55c5f" released by "_delete_snapshot" :: held 2.664s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:21:57 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] Lock "cinder-quobyte-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a" released by "delete_snapshot" :: held 2.719s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:21:57 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] Created reservations ['8128b72c-68b9-47c7-9509-69ecc2816b22', '01447e25-8cc5-422d-bd0a-e9987e925b3b', 'dc6e887a-17bb-4ee9-ac30-7e744e387c31', '79a593b4-84dc-4705-9bd5-85877e264653'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:21:57 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] Delete snapshot completed successfully.
Sep 22 23:21:57 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a2b6af5d-2975-4ea9-9370-cc99a00e32f4 tempest-VolumesExtendTest-925783615 None] Lock "cinder-766c8785-934a-4308-b872-f4ed97a55c5f-delete_snapshot" released by "delete_snapshot" :: held 3.244s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:21:58 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1166746d-63d8-48b9-a363-22a0f5220a8c tempest-VolumesExtendTest-925783615 None] Acquiring lock "cinder-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:21:58 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1166746d-63d8-48b9-a363-22a0f5220a8c tempest-VolumesExtendTest-925783615 None] Lock "cinder-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:21:59 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-1166746d-63d8-48b9-a363-22a0f5220a8c tempest-VolumesExtendTest-925783615 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:21:59 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1166746d-63d8-48b9-a363-22a0f5220a8c tempest-VolumesExtendTest-925783615 None] Acquiring lock "cinder-quobyte-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:21:59 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1166746d-63d8-48b9-a363-22a0f5220a8c tempest-VolumesExtendTest-925783615 None] Lock "cinder-quobyte-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a" acquired by "delete_volume" :: waited 0.016s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:21:59 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cfacaf-3830-4a92-a3f6-3c3d7162103e]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:21:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1166746d-63d8-48b9-a363-22a0f5220a8c tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1166746d-63d8-48b9-a363-22a0f5220a8c tempest-VolumesExtendTest-925783615 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a" returned: 0 in 0.528s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1166746d-63d8-48b9-a363-22a0f5220a8c tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:21:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1166746d-63d8-48b9-a363-22a0f5220a8c tempest-VolumesExtendTest-925783615 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a" returned: 0 in 0.176s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:21:59 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1166746d-63d8-48b9-a363-22a0f5220a8c tempest-VolumesExtendTest-925783615 None] Lock "cinder-quobyte-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a" released by "delete_volume" :: held 0.935s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:22:00 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-1166746d-63d8-48b9-a363-22a0f5220a8c tempest-VolumesExtendTest-925783615 None] Created reservations ['22c1f141-4423-42bf-b467-850718ed1174', '875b603c-40e7-4ebb-b9d7-6de559f46c59', 'bcc14dbb-7cd7-4db2-8bd1-2039c775e086', '76a6b4b6-8149-41b1-8def-d5ec32b2a9ec'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:22:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1166746d-63d8-48b9-a363-22a0f5220a8c tempest-VolumesExtendTest-925783615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:22:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1166746d-63d8-48b9-a363-22a0f5220a8c tempest-VolumesExtendTest-925783615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:22:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1166746d-63d8-48b9-a363-22a0f5220a8c tempest-VolumesExtendTest-925783615 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:22:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1166746d-63d8-48b9-a363-22a0f5220a8c tempest-VolumesExtendTest-925783615 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:22:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1166746d-63d8-48b9-a363-22a0f5220a8c tempest-VolumesExtendTest-925783615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:22:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1166746d-63d8-48b9-a363-22a0f5220a8c tempest-VolumesExtendTest-925783615 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1166746d-63d8-48b9-a363-22a0f5220a8c tempest-VolumesExtendTest-925783615 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.178s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:01 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-1166746d-63d8-48b9-a363-22a0f5220a8c tempest-VolumesExtendTest-925783615 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:22:01 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-1166746d-63d8-48b9-a363-22a0f5220a8c tempest-VolumesExtendTest-925783615 None] Deleted volume successfully.
Sep 22 23:22:01 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1166746d-63d8-48b9-a363-22a0f5220a8c tempest-VolumesExtendTest-925783615 None] Lock "cinder-2cbecb1b-d65f-46d4-bce5-a44fd8ea6c9a-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:22:06 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:22:06 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:22:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Flow 'volume_create_manager' (3479a762-99da-4579-932d-60a8c64727ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:22:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a092a5f-1eb1-485c-8f47-95a4556c5294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a092a5f-1eb1-485c-8f47-95a4556c5294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1214825357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937e6e58-2135-468a-a819-94a742def421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cc2dfff8c3746c5a9effcc9a4c9d495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:22:07Z,use_quota=True,user_id='469125da885a432a9ff12f04f450146f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e0bbd8-4d36-43c6-95d7-4d4db40b221c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e0bbd8-4d36-43c6-95d7-4d4db40b221c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de00d4e-e652-426b-a7f0-1283ff3e103c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de00d4e-e652-426b-a7f0-1283ff3e103c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '937e6e58-2135-468a-a819-94a742def421', 'volume_name': 'volume-937e6e58-2135-468a-a819-94a742def421', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07e27fc-5023-4b7c-89be-bbfad91f4ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07e27fc-5023-4b7c-89be-bbfad91f4ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8ff4bc-bbe4-4a67-bd58-ea492ce0103c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:22:07 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Volume 937e6e58-2135-468a-a819-94a742def421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-937e6e58-2135-468a-a819-94a742def421', 'volume_size': 1}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1214825357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937e6e58-2135-468a-a819-94a742def421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cc2dfff8c3746c5a9effcc9a4c9d495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:22:07Z,use_quota=True,user_id='469125da885a432a9ff12f04f450146f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Creating volume 937e6e58-2135-468a-a819-94a742def421 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:22:07 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:07 devstack quobyte-client[84065]: System call of process 91507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:07 devstack quobyte-client[84065]: System call of process 91507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:07 devstack quobyte-client[84065]: System call of process 91507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:07 devstack quobyte-client[84065]: System call of process 91507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:07 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=44, name=volume-937e6e58-2135-468a-a819-94a742def421, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421 1073741824" returned: 0 in 0.458s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421" returned: 0 in 0.235s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] <== create_volume: return (782ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:22:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:22:08 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8ff4bc-bbe4-4a67-bd58-ea492ce0103c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-937e6e58-2135-468a-a819-94a742def421', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:22:08 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47abc235-1ad7-4178-aedb-672912d552f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:22:08 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Volume volume-937e6e58-2135-468a-a819-94a742def421 (937e6e58-2135-468a-a819-94a742def421): created successfully
Sep 22 23:22:08 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47abc235-1ad7-4178-aedb-672912d552f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:22:08 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Flow 'volume_create_manager' (3479a762-99da-4579-932d-60a8c64727ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:22:08 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-bb7d4e14-9e5c-4341-971f-d0a1e57cd060 tempest-VolumesSnapshotListTestJSON-590735238 None] Created volume successfully.
Sep 22 23:22:09 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:22:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:22:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:22:09 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] Creating offline snapshot 2b98b6cd-b424-4ea4-852c-6ba6a87ff290 of volume 937e6e58-2135-468a-a819-94a742def421 {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:22:09 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[858f6706-b237-48e3-ba9d-91268eba6b9e]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:22:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:10 devstack quobyte-client[84065]: System call of process 91511 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421" returned: 0 in 0.526s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:10 devstack quobyte-client[84065]: System call of process 91514 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:10 devstack quobyte-client[84065]: System call of process 91514 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:10 devstack quobyte-client[84065]: System call of process 91514 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:10 devstack quobyte-client[84065]: System call of process 91514 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:10 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=45, name=volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:22:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290 1G" returned: 0 in 0.357s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): qemu-img rebase -u -b volume-937e6e58-2135-468a-a819-94a742def421 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "qemu-img rebase -u -b volume-937e6e58-2135-468a-a819-94a742def421 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290" returned: 0 in 0.197s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:10 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:22:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290" returned: 0 in 0.136s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:11 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421 -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:22:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290" returned: 0 in 0.103s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.info" returned: 0 in 0.109s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:11 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.info is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:22:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.info" returned: 0 in 0.101s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:22:11 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-8c90f2b1-8cad-44f6-bec2-bba8fbfac92e tempest-VolumesSnapshotListTestJSON-590735238 None] Create snapshot completed successfully
Sep 22 23:22:12 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-ddeff11d-71be-4c97-ab6a-b93df6a581d7 tempest-VolumesSnapshotListTestJSON-590735238 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:22:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ddeff11d-71be-4c97-ab6a-b93df6a581d7 tempest-VolumesSnapshotListTestJSON-590735238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:22:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ddeff11d-71be-4c97-ab6a-b93df6a581d7 tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:22:12 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-ddeff11d-71be-4c97-ab6a-b93df6a581d7 tempest-VolumesSnapshotListTestJSON-590735238 None] Creating offline snapshot 727ca435-c3de-4e9e-8aae-ddda94246175 of volume 937e6e58-2135-468a-a819-94a742def421 {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:22:13 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f373a88-bee0-486b-95b7-9c5470230efb]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:22:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ddeff11d-71be-4c97-ab6a-b93df6a581d7 tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:13 devstack quobyte-client[84065]: System call of process 91524 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ddeff11d-71be-4c97-ab6a-b93df6a581d7 tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290" returned: 0 in 0.528s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:13 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-ddeff11d-71be-4c97-ab6a-b93df6a581d7 tempest-VolumesSnapshotListTestJSON-590735238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-937e6e58-2135-468a-a819-94a742def421(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:22:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ddeff11d-71be-4c97-ab6a-b93df6a581d7 tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:13 devstack quobyte-client[84065]: System call of process 91552 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:13 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=47, name=volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:22:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ddeff11d-71be-4c97-ab6a-b93df6a581d7 tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175 1G" returned: 0 in 0.437s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ddeff11d-71be-4c97-ab6a-b93df6a581d7 tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): qemu-img rebase -u -b volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:14 devstack quobyte-client[84065]: System call of process 91559 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ddeff11d-71be-4c97-ab6a-b93df6a581d7 tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "qemu-img rebase -u -b volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175" returned: 0 in 0.156s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-ddeff11d-71be-4c97-ab6a-b93df6a581d7 tempest-VolumesSnapshotListTestJSON-590735238 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:22:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ddeff11d-71be-4c97-ab6a-b93df6a581d7 tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ddeff11d-71be-4c97-ab6a-b93df6a581d7 tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175" returned: 0 in 0.085s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-ddeff11d-71be-4c97-ab6a-b93df6a581d7 tempest-VolumesSnapshotListTestJSON-590735238 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290 -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:22:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ddeff11d-71be-4c97-ab6a-b93df6a581d7 tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ddeff11d-71be-4c97-ab6a-b93df6a581d7 tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175" returned: 0 in 0.085s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ddeff11d-71be-4c97-ab6a-b93df6a581d7 tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.593s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:22:14 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-ddeff11d-71be-4c97-ab6a-b93df6a581d7 tempest-VolumesSnapshotListTestJSON-590735238 None] Create snapshot completed successfully
Sep 22 23:22:15 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-3f64f029-a4cd-409c-87b1-28e78a524cfa tempest-VolumesSnapshotListTestJSON-590735238 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:22:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3f64f029-a4cd-409c-87b1-28e78a524cfa tempest-VolumesSnapshotListTestJSON-590735238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:22:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3f64f029-a4cd-409c-87b1-28e78a524cfa tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:22:15 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-3f64f029-a4cd-409c-87b1-28e78a524cfa tempest-VolumesSnapshotListTestJSON-590735238 None] Creating offline snapshot 0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1 of volume 937e6e58-2135-468a-a819-94a742def421 {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:22:15 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7cd116-67dc-4c27-bb39-ff8196f445b0]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:22:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3f64f029-a4cd-409c-87b1-28e78a524cfa tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:15 devstack quobyte-client[84065]: System call of process 91564 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:15 devstack quobyte-client[84065]: System call of process 91564 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3f64f029-a4cd-409c-87b1-28e78a524cfa tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175" returned: 0 in 0.430s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:15 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-3f64f029-a4cd-409c-87b1-28e78a524cfa tempest-VolumesSnapshotListTestJSON-590735238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-937e6e58-2135-468a-a819-94a742def421(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:22:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3f64f029-a4cd-409c-87b1-28e78a524cfa tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:15 devstack quobyte-client[84065]: System call of process 91570 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:15 devstack quobyte-client[84065]: System call of process 91570 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:16 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=48, name=volume-937e6e58-2135-468a-a819-94a742def421.0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:22:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3f64f029-a4cd-409c-87b1-28e78a524cfa tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1 1G" returned: 0 in 0.466s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3f64f029-a4cd-409c-87b1-28e78a524cfa tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): qemu-img rebase -u -b volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:16 devstack quobyte-client[84065]: System call of process 91574 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:16 devstack quobyte-client[84065]: System call of process 91574 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:16 devstack quobyte-client[84065]: System call of process 91574 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3f64f029-a4cd-409c-87b1-28e78a524cfa tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "qemu-img rebase -u -b volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1" returned: 0 in 0.232s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-3f64f029-a4cd-409c-87b1-28e78a524cfa tempest-VolumesSnapshotListTestJSON-590735238 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:22:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3f64f029-a4cd-409c-87b1-28e78a524cfa tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3f64f029-a4cd-409c-87b1-28e78a524cfa tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1" returned: 0 in 0.103s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-3f64f029-a4cd-409c-87b1-28e78a524cfa tempest-VolumesSnapshotListTestJSON-590735238 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175 -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:22:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3f64f029-a4cd-409c-87b1-28e78a524cfa tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3f64f029-a4cd-409c-87b1-28e78a524cfa tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1" returned: 0 in 0.102s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3f64f029-a4cd-409c-87b1-28e78a524cfa tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.663s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:22:17 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-3f64f029-a4cd-409c-87b1-28e78a524cfa tempest-VolumesSnapshotListTestJSON-590735238 None] Create snapshot completed successfully
Sep 22 23:22:19 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=44,cinder:DELETE=4,cinder:SELECT=43,cinder:INSERT=11 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:22:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] Acquiring lock "cinder-0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:22:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.108s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:22:20 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:22:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] Acquiring lock "cinder-quobyte-937e6e58-2135-468a-a819-94a742def421" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:22:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-quobyte-937e6e58-2135-468a-a819-94a742def421" acquired by "delete_snapshot" :: waited 0.076s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:22:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] Acquiring lock "cinder-quobyte-0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:22:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-quobyte-0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:22:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] Deleting offline snapshot 0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1 of volume 937e6e58-2135-468a-a819-94a742def421 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:22:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] snapshot_file for this snap is: volume-937e6e58-2135-468a-a819-94a742def421.0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:22:20 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2e5c32-4bbd-409c-af66-5630decc634d]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:22:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1" returned: 0 in 0.850s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:21 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-937e6e58-2135-468a-a819-94a742def421(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:22:21 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed614a9-c90a-4206-9c94-883f64a96d86]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:22:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175" returned: 0 in 0.602s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:22 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-937e6e58-2135-468a-a819-94a742def421(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:22:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:22 devstack quobyte-client[84065]: System call of process 91661 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:22 devstack quobyte-client[84065]: System call of process 91661 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1" returned: 0 in 0.809s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1" returned: 0 in 0.283s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:23 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-quobyte-0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1" released by "_delete_snapshot" :: held 3.365s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:22:23 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-quobyte-937e6e58-2135-468a-a819-94a742def421" released by "delete_snapshot" :: held 3.447s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:22:24 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] Created reservations ['6959b648-a304-4743-a2a5-49bec618c07e', '69a5dae6-7278-4d9b-8bcd-591c5296b9d5', 'c947993e-8a3c-45ad-a5cb-4a0fcee8eefa', 'd0d04c3f-5493-446a-a8ea-bf211c9e30ce'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:22:24 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] Delete snapshot completed successfully.
Sep 22 23:22:24 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5b1ad126-6b66-42b1-931a-75e34c444fab tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-0e2ca2d0-ef8c-49a1-b445-c2ea7deca4b1-delete_snapshot" released by "delete_snapshot" :: held 4.242s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:22:25 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] Acquiring lock "cinder-727ca435-c3de-4e9e-8aae-ddda94246175-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:22:25 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-727ca435-c3de-4e9e-8aae-ddda94246175-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:22:25 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:22:25 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] Acquiring lock "cinder-quobyte-937e6e58-2135-468a-a819-94a742def421" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:22:25 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-quobyte-937e6e58-2135-468a-a819-94a742def421" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:22:25 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] Acquiring lock "cinder-quobyte-727ca435-c3de-4e9e-8aae-ddda94246175" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:22:25 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-quobyte-727ca435-c3de-4e9e-8aae-ddda94246175" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:22:25 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] Deleting offline snapshot 727ca435-c3de-4e9e-8aae-ddda94246175 of volume 937e6e58-2135-468a-a819-94a742def421 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:22:25 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] snapshot_file for this snap is: volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:22:25 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6981d67d-c6de-4628-a9eb-e93d44c045cc]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:22:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:26 devstack quobyte-client[84065]: System call of process 91694 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175" returned: 0 in 0.855s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:26 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-937e6e58-2135-468a-a819-94a742def421(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:22:26 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24248a6-8cff-4b32-914c-cfdd7e48a46a]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:22:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:28 devstack quobyte-client[84065]: System call of process 91703 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:28 devstack quobyte-client[84065]: System call of process 91703 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:28 devstack quobyte-client[84065]: System call of process 91703 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:28 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-46e3f37d-24a4-4712-80dd-9dbab66cbcbd req-2a584678-e28b-40b2-81cf-abe6a4ff8d31 tempest-AttachVolumeNegativeTest-394912296 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:22:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290" returned: 0 in 2.057s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:28 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-937e6e58-2135-468a-a819-94a742def421(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:22:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:29 devstack quobyte-client[84065]: System call of process 91718 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:29 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-46e3f37d-24a4-4712-80dd-9dbab66cbcbd req-2a584678-e28b-40b2-81cf-abe6a4ff8d31 tempest-AttachVolumeNegativeTest-394912296 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:22:29 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-46e3f37d-24a4-4712-80dd-9dbab66cbcbd req-2a584678-e28b-40b2-81cf-abe6a4ff8d31 tempest-AttachVolumeNegativeTest-394912296 None] Terminate volume connection completed successfully.
Sep 22 23:22:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-46e3f37d-24a4-4712-80dd-9dbab66cbcbd req-2a584678-e28b-40b2-81cf-abe6a4ff8d31 tempest-AttachVolumeNegativeTest-394912296 None] Deleting attachment 2b1a52dc-2699-4b52-9292-1e248d649de1. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:22:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175" returned: 0 in 0.720s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.727ca435-c3de-4e9e-8aae-ddda94246175" returned: 0 in 0.298s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:30 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-quobyte-727ca435-c3de-4e9e-8aae-ddda94246175" released by "_delete_snapshot" :: held 4.691s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:22:30 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-quobyte-937e6e58-2135-468a-a819-94a742def421" released by "delete_snapshot" :: held 4.766s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:22:30 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] Created reservations ['06747ac8-5a89-4a15-a04d-2340b6dacf11', '4c128df2-24ae-42de-ac91-8d4cc23378c9', 'ae72847f-4ff6-490a-af1e-ccba64bcd806', '4b804a65-1922-4d2b-804d-b9ced60f2740'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:22:31 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] Delete snapshot completed successfully.
Sep 22 23:22:31 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4677bca6-cd67-4b42-a597-7b7fb5db9bf1 tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-727ca435-c3de-4e9e-8aae-ddda94246175-delete_snapshot" released by "delete_snapshot" :: held 5.716s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:22:31 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] Acquiring lock "cinder-2b98b6cd-b424-4ea4-852c-6ba6a87ff290-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:22:31 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-2b98b6cd-b424-4ea4-852c-6ba6a87ff290-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:22:31 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:22:31 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] Acquiring lock "cinder-quobyte-937e6e58-2135-468a-a819-94a742def421" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:22:31 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-quobyte-937e6e58-2135-468a-a819-94a742def421" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:22:31 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] Acquiring lock "cinder-quobyte-2b98b6cd-b424-4ea4-852c-6ba6a87ff290" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:22:31 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-quobyte-2b98b6cd-b424-4ea4-852c-6ba6a87ff290" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:22:31 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] Deleting offline snapshot 2b98b6cd-b424-4ea4-852c-6ba6a87ff290 of volume 937e6e58-2135-468a-a819-94a742def421 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:22:32 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] snapshot_file for this snap is: volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:22:32 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8d8d8b-8aba-484d-8bf4-01187dda7a54]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:22:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:32 devstack quobyte-client[84065]: System call of process 91726 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:32 devstack quobyte-client[84065]: System call of process 91726 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290" returned: 0 in 0.866s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:32 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-937e6e58-2135-468a-a819-94a742def421(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:22:33 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f69537f-b9f6-4b1e-b5a4-44db90e38339]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:22:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:34 devstack quobyte-client[84065]: System call of process 91729 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421" returned: 0 in 2.116s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290" returned: 0 in 0.381s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421.2b98b6cd-b424-4ea4-852c-6ba6a87ff290" returned: 0 in 0.206s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:36 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-quobyte-2b98b6cd-b424-4ea4-852c-6ba6a87ff290" released by "_delete_snapshot" :: held 4.037s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:22:36 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-quobyte-937e6e58-2135-468a-a819-94a742def421" released by "delete_snapshot" :: held 4.081s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:22:36 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] Created reservations ['f877cb60-60c6-4a18-ada0-6f0fcb47d444', 'b08b001e-9b1b-4de2-bb00-ce06a2772212', '607d5ec7-669f-4399-a75b-18a989b74761', 'ace5c273-226d-406c-9461-c985b010b5de'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:22:36 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] Delete snapshot completed successfully.
Sep 22 23:22:36 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c69cc9ed-7e6a-4e3b-aa29-8e223c0178a0 tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-2b98b6cd-b424-4ea4-852c-6ba6a87ff290-delete_snapshot" released by "delete_snapshot" :: held 4.993s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:22:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-12b4d759-b2a6-406d-97d1-d2de1efc4b0f tempest-VolumesSnapshotListTestJSON-590735238 None] Acquiring lock "cinder-937e6e58-2135-468a-a819-94a742def421-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:22:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-12b4d759-b2a6-406d-97d1-d2de1efc4b0f tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-937e6e58-2135-468a-a819-94a742def421-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:22:38 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-12b4d759-b2a6-406d-97d1-d2de1efc4b0f tempest-VolumesSnapshotListTestJSON-590735238 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:22:38 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-12b4d759-b2a6-406d-97d1-d2de1efc4b0f tempest-VolumesSnapshotListTestJSON-590735238 None] Acquiring lock "cinder-quobyte-937e6e58-2135-468a-a819-94a742def421" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:22:38 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-12b4d759-b2a6-406d-97d1-d2de1efc4b0f tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-quobyte-937e6e58-2135-468a-a819-94a742def421" acquired by "delete_volume" :: waited 0.050s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:22:38 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6375f667-148c-4470-a840-91418fdb247f]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:22:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-12b4d759-b2a6-406d-97d1-d2de1efc4b0f tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:39 devstack quobyte-client[84065]: System call of process 91779 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:22:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-12b4d759-b2a6-406d-97d1-d2de1efc4b0f tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421" returned: 0 in 1.743s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-12b4d759-b2a6-406d-97d1-d2de1efc4b0f tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-12b4d759-b2a6-406d-97d1-d2de1efc4b0f tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-937e6e58-2135-468a-a819-94a742def421" returned: 0 in 0.111s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:40 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-12b4d759-b2a6-406d-97d1-d2de1efc4b0f tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-quobyte-937e6e58-2135-468a-a819-94a742def421" released by "delete_volume" :: held 2.124s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:22:40 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-12b4d759-b2a6-406d-97d1-d2de1efc4b0f tempest-VolumesSnapshotListTestJSON-590735238 None] Created reservations ['95ca78c5-c228-4200-b36b-215f62deac64', '4576b5e1-c79b-4236-8006-fa88f02550ed', '34b04ff5-9fed-40a5-a472-7aa4b1e1d2fd', 'a957e542-513d-4d47-9d79-194ec811c229'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:22:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-12b4d759-b2a6-406d-97d1-d2de1efc4b0f tempest-VolumesSnapshotListTestJSON-590735238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:22:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-12b4d759-b2a6-406d-97d1-d2de1efc4b0f tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:22:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-12b4d759-b2a6-406d-97d1-d2de1efc4b0f tempest-VolumesSnapshotListTestJSON-590735238 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:22:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-12b4d759-b2a6-406d-97d1-d2de1efc4b0f tempest-VolumesSnapshotListTestJSON-590735238 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:22:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-12b4d759-b2a6-406d-97d1-d2de1efc4b0f tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:22:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-12b4d759-b2a6-406d-97d1-d2de1efc4b0f tempest-VolumesSnapshotListTestJSON-590735238 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-12b4d759-b2a6-406d-97d1-d2de1efc4b0f tempest-VolumesSnapshotListTestJSON-590735238 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.106s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:41 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-12b4d759-b2a6-406d-97d1-d2de1efc4b0f tempest-VolumesSnapshotListTestJSON-590735238 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:22:41 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-12b4d759-b2a6-406d-97d1-d2de1efc4b0f tempest-VolumesSnapshotListTestJSON-590735238 None] Deleted volume successfully.
Sep 22 23:22:41 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=53,cinder:UPDATE=56,cinder:INSERT=10,cinder:DELETE=7 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:22:41 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-12b4d759-b2a6-406d-97d1-d2de1efc4b0f tempest-VolumesSnapshotListTestJSON-590735238 None] Lock "cinder-937e6e58-2135-468a-a819-94a742def421-delete_volume" released by "delete_volume" :: held 3.426s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:22:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:22:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:22:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:22:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:22:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:22:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:22:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:22:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.224s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:22:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:22:50 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=18,cinder:INSERT=12,cinder:UPDATE=27 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:23:47 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4742156c-2f31-4ba1-bec5-438d37e5cb41 tempest-AttachVolumeShelveTestJSON-1091243525 None] Acquiring lock "cinder-3b8ecaef-441b-46cd-9598-1be73635c83d-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:23:47 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4742156c-2f31-4ba1-bec5-438d37e5cb41 tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "cinder-3b8ecaef-441b-46cd-9598-1be73635c83d-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:23:47 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-4742156c-2f31-4ba1-bec5-438d37e5cb41 tempest-AttachVolumeShelveTestJSON-1091243525 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:23:47 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4742156c-2f31-4ba1-bec5-438d37e5cb41 tempest-AttachVolumeShelveTestJSON-1091243525 None] Acquiring lock "cinder-quobyte-3b8ecaef-441b-46cd-9598-1be73635c83d" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:23:47 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4742156c-2f31-4ba1-bec5-438d37e5cb41 tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "cinder-quobyte-3b8ecaef-441b-46cd-9598-1be73635c83d" acquired by "delete_volume" :: waited 0.025s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:23:47 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb16f598-81fe-406d-b000-66b3c36389ef]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:23:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4742156c-2f31-4ba1-bec5-438d37e5cb41 tempest-AttachVolumeShelveTestJSON-1091243525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3b8ecaef-441b-46cd-9598-1be73635c83d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:23:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:23:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:23:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:23:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:23:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:23:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:23:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:23:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.273s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:23:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:23:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4742156c-2f31-4ba1-bec5-438d37e5cb41 tempest-AttachVolumeShelveTestJSON-1091243525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3b8ecaef-441b-46cd-9598-1be73635c83d" returned: 0 in 0.767s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:23:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4742156c-2f31-4ba1-bec5-438d37e5cb41 tempest-AttachVolumeShelveTestJSON-1091243525 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3b8ecaef-441b-46cd-9598-1be73635c83d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:23:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4742156c-2f31-4ba1-bec5-438d37e5cb41 tempest-AttachVolumeShelveTestJSON-1091243525 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3b8ecaef-441b-46cd-9598-1be73635c83d" returned: 0 in 0.117s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:23:48 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4742156c-2f31-4ba1-bec5-438d37e5cb41 tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "cinder-quobyte-3b8ecaef-441b-46cd-9598-1be73635c83d" released by "delete_volume" :: held 1.096s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:23:48 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-4742156c-2f31-4ba1-bec5-438d37e5cb41 tempest-AttachVolumeShelveTestJSON-1091243525 None] Created reservations ['ed92e12f-eb1a-4c91-8de3-11a8a8824f27', '4dd07207-7f97-4c03-b6ee-0318515ab900', '41ab9dc2-d658-44b7-8be8-dfaec9b053f7', '86f1f514-d7a9-437e-aee4-b9755b1dd9db'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:23:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4742156c-2f31-4ba1-bec5-438d37e5cb41 tempest-AttachVolumeShelveTestJSON-1091243525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:23:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4742156c-2f31-4ba1-bec5-438d37e5cb41 tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:23:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-4742156c-2f31-4ba1-bec5-438d37e5cb41 tempest-AttachVolumeShelveTestJSON-1091243525 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:23:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-4742156c-2f31-4ba1-bec5-438d37e5cb41 tempest-AttachVolumeShelveTestJSON-1091243525 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:23:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4742156c-2f31-4ba1-bec5-438d37e5cb41 tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:23:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4742156c-2f31-4ba1-bec5-438d37e5cb41 tempest-AttachVolumeShelveTestJSON-1091243525 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:23:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4742156c-2f31-4ba1-bec5-438d37e5cb41 tempest-AttachVolumeShelveTestJSON-1091243525 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.289s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:23:49 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-4742156c-2f31-4ba1-bec5-438d37e5cb41 tempest-AttachVolumeShelveTestJSON-1091243525 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:23:50 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-4742156c-2f31-4ba1-bec5-438d37e5cb41 tempest-AttachVolumeShelveTestJSON-1091243525 None] Deleted volume successfully.
Sep 22 23:23:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ce533ef7-27dd-4a99-8be2-dd297b945dd9 tempest-AttachVolumeShelveTestJSON-1091243525 None] Acquiring lock "cinder-620cd253-8697-4dc5-acbf-a6db48d27e29-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:23:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4742156c-2f31-4ba1-bec5-438d37e5cb41 tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "cinder-3b8ecaef-441b-46cd-9598-1be73635c83d-delete_volume" released by "delete_volume" :: held 3.689s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:23:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ce533ef7-27dd-4a99-8be2-dd297b945dd9 tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "cinder-620cd253-8697-4dc5-acbf-a6db48d27e29-delete_volume" acquired by "delete_volume" :: waited 0.304s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:23:51 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-ce533ef7-27dd-4a99-8be2-dd297b945dd9 tempest-AttachVolumeShelveTestJSON-1091243525 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:23:51 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ce533ef7-27dd-4a99-8be2-dd297b945dd9 tempest-AttachVolumeShelveTestJSON-1091243525 None] Acquiring lock "cinder-quobyte-620cd253-8697-4dc5-acbf-a6db48d27e29" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:23:51 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ce533ef7-27dd-4a99-8be2-dd297b945dd9 tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "cinder-quobyte-620cd253-8697-4dc5-acbf-a6db48d27e29" acquired by "delete_volume" :: waited 0.026s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:23:51 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01ca1e3-74c8-44e6-8adf-f1bb2b46b044]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:23:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ce533ef7-27dd-4a99-8be2-dd297b945dd9 tempest-AttachVolumeShelveTestJSON-1091243525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-620cd253-8697-4dc5-acbf-a6db48d27e29 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:23:52 devstack quobyte-client[84065]: System call of process 92021 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:23:52 devstack quobyte-client[84065]: System call of process 92021 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:23:52 devstack quobyte-client[84065]: System call of process 92021 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:23:52 devstack quobyte-client[84065]: System call of process 92021 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:23:52 devstack quobyte-client[84065]: System call of process 92021 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:23:52 devstack quobyte-client[84065]: System call of process 92021 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:23:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ce533ef7-27dd-4a99-8be2-dd297b945dd9 tempest-AttachVolumeShelveTestJSON-1091243525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-620cd253-8697-4dc5-acbf-a6db48d27e29" returned: 0 in 1.163s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:23:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ce533ef7-27dd-4a99-8be2-dd297b945dd9 tempest-AttachVolumeShelveTestJSON-1091243525 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-620cd253-8697-4dc5-acbf-a6db48d27e29 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:23:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ce533ef7-27dd-4a99-8be2-dd297b945dd9 tempest-AttachVolumeShelveTestJSON-1091243525 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-620cd253-8697-4dc5-acbf-a6db48d27e29" returned: 0 in 0.230s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:23:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ce533ef7-27dd-4a99-8be2-dd297b945dd9 tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "cinder-quobyte-620cd253-8697-4dc5-acbf-a6db48d27e29" released by "delete_volume" :: held 1.787s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:23:53 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-ce533ef7-27dd-4a99-8be2-dd297b945dd9 tempest-AttachVolumeShelveTestJSON-1091243525 None] Created reservations ['185f7878-aca7-4868-a386-eac93d4a1820', '8592e43a-5fac-4055-8df3-6a183210b83a', 'b84f0795-3148-4892-ae1b-9bb70ffc5537', 'b7ed9bb8-f549-477a-9b3d-1d3d3cb8b425'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:23:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ce533ef7-27dd-4a99-8be2-dd297b945dd9 tempest-AttachVolumeShelveTestJSON-1091243525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:23:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ce533ef7-27dd-4a99-8be2-dd297b945dd9 tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:23:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ce533ef7-27dd-4a99-8be2-dd297b945dd9 tempest-AttachVolumeShelveTestJSON-1091243525 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:23:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ce533ef7-27dd-4a99-8be2-dd297b945dd9 tempest-AttachVolumeShelveTestJSON-1091243525 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:23:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ce533ef7-27dd-4a99-8be2-dd297b945dd9 tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:23:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ce533ef7-27dd-4a99-8be2-dd297b945dd9 tempest-AttachVolumeShelveTestJSON-1091243525 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:23:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ce533ef7-27dd-4a99-8be2-dd297b945dd9 tempest-AttachVolumeShelveTestJSON-1091243525 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.167s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:23:54 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-ce533ef7-27dd-4a99-8be2-dd297b945dd9 tempest-AttachVolumeShelveTestJSON-1091243525 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:23:54 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-ce533ef7-27dd-4a99-8be2-dd297b945dd9 tempest-AttachVolumeShelveTestJSON-1091243525 None] Deleted volume successfully.
Sep 22 23:23:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ce533ef7-27dd-4a99-8be2-dd297b945dd9 tempest-AttachVolumeShelveTestJSON-1091243525 None] Lock "cinder-620cd253-8697-4dc5-acbf-a6db48d27e29-delete_volume" released by "delete_volume" :: held 4.034s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:24:03 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=9,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:24:04 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=11,cinder:UPDATE=17,cinder:INSERT=8,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:24:28 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:24:32 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:24:32 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:24:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Flow 'volume_create_manager' (adbed857-7034-4aa0-b5e3-8f3ce7f050d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:24:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8927f510-4dce-4019-9577-19d8218a4aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:24:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8927f510-4dce-4019-9577-19d8218a4aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-486262760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=733dd659-2662-4b8b-be1e-5d6980d0973f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838892ace8b2480cb449321c05f51da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:24:32Z,use_quota=True,user_id='8fd961a280d94838b29811c87cfc65b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:24:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e660f54d-76aa-4749-bee9-ebad65a97fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:24:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e660f54d-76aa-4749-bee9-ebad65a97fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:24:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d64c20d-0824-4826-aa7e-fe0f412870ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:24:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d64c20d-0824-4826-aa7e-fe0f412870ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '733dd659-2662-4b8b-be1e-5d6980d0973f', 'volume_name': 'volume-733dd659-2662-4b8b-be1e-5d6980d0973f', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:24:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ea9509-11e3-45a2-98d6-8c52465ca321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:24:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ea9509-11e3-45a2-98d6-8c52465ca321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:24:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d53e81-bd40-48c6-a03e-c9e3fd3b3b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:24:33 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Volume 733dd659-2662-4b8b-be1e-5d6980d0973f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-733dd659-2662-4b8b-be1e-5d6980d0973f', 'volume_size': 1}
Sep 22 23:24:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:24:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:24:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-486262760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=733dd659-2662-4b8b-be1e-5d6980d0973f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838892ace8b2480cb449321c05f51da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:24:32Z,use_quota=True,user_id='8fd961a280d94838b29811c87cfc65b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:24:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Creating volume 733dd659-2662-4b8b-be1e-5d6980d0973f {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:24:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:24:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:24:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:24:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:24:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:24:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:24:33 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:24:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-733dd659-2662-4b8b-be1e-5d6980d0973f 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:24:33 devstack quobyte-client[84065]: System call of process 92229 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:24:33 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=49, name=volume-733dd659-2662-4b8b-be1e-5d6980d0973f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:24:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-733dd659-2662-4b8b-be1e-5d6980d0973f 1073741824" returned: 0 in 1.154s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:24:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-733dd659-2662-4b8b-be1e-5d6980d0973f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:24:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-733dd659-2662-4b8b-be1e-5d6980d0973f" returned: 0 in 0.461s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:24:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] <== create_volume: return (1918ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:24:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:24:35 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d53e81-bd40-48c6-a03e-c9e3fd3b3b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-733dd659-2662-4b8b-be1e-5d6980d0973f', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:24:35 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e339a6-b309-49b2-ba2e-e556e8666aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:24:35 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Volume volume-733dd659-2662-4b8b-be1e-5d6980d0973f (733dd659-2662-4b8b-be1e-5d6980d0973f): created successfully
Sep 22 23:24:35 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e339a6-b309-49b2-ba2e-e556e8666aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:24:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Flow 'volume_create_manager' (adbed857-7034-4aa0-b5e3-8f3ce7f050d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:24:36 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-ee1a7bec-809e-4eb4-982a-aa58b97ed46c tempest-AttachVolumeNegativeTest-394912296 None] Created volume successfully.
Sep 22 23:24:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-0884b0a6-9a80-400f-a6f4-d38e07764e86 req-637f5e8d-2ef6-4616-a7f4-69a0d71bea70 tempest-AttachVolumeNegativeTest-394912296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:24:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-0884b0a6-9a80-400f-a6f4-d38e07764e86 req-637f5e8d-2ef6-4616-a7f4-69a0d71bea70 tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:24:41 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[45600c96-1db9-4bca-a000-a9cf41bb9dae]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:24:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-0884b0a6-9a80-400f-a6f4-d38e07764e86 req-637f5e8d-2ef6-4616-a7f4-69a0d71bea70 tempest-AttachVolumeNegativeTest-394912296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-733dd659-2662-4b8b-be1e-5d6980d0973f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:24:42 devstack quobyte-client[84065]: System call of process 92243 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:24:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-0884b0a6-9a80-400f-a6f4-d38e07764e86 req-637f5e8d-2ef6-4616-a7f4-69a0d71bea70 tempest-AttachVolumeNegativeTest-394912296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-733dd659-2662-4b8b-be1e-5d6980d0973f" returned: 0 in 1.010s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:24:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-0884b0a6-9a80-400f-a6f4-d38e07764e86 req-637f5e8d-2ef6-4616-a7f4-69a0d71bea70 tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.149s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:24:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-0884b0a6-9a80-400f-a6f4-d38e07764e86 req-637f5e8d-2ef6-4616-a7f4-69a0d71bea70 tempest-AttachVolumeNegativeTest-394912296 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-733dd659-2662-4b8b-be1e-5d6980d0973f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '76bc43e6-121a-4eec-9ed6-cbb89f171d32', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:24:43 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-0884b0a6-9a80-400f-a6f4-d38e07764e86 req-637f5e8d-2ef6-4616-a7f4-69a0d71bea70 tempest-AttachVolumeNegativeTest-394912296 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:24:43 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-0884b0a6-9a80-400f-a6f4-d38e07764e86 req-637f5e8d-2ef6-4616-a7f4-69a0d71bea70 tempest-AttachVolumeNegativeTest-394912296 None] attachment_update completed successfully.
Sep 22 23:24:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:24:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:24:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.029s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:24:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:24:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:24:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.113s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:24:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:24:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.350s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:24:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:24:53 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:24:53 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:25:15 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-9423ee13-9362-490b-b912-8e5ce30ddbb3 req-a592328d-4f1a-4686-ac5c-f0d6b6556dff tempest-AttachVolumeNegativeTest-394912296 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:25:16 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-9423ee13-9362-490b-b912-8e5ce30ddbb3 req-a592328d-4f1a-4686-ac5c-f0d6b6556dff tempest-AttachVolumeNegativeTest-394912296 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:25:16 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-9423ee13-9362-490b-b912-8e5ce30ddbb3 req-a592328d-4f1a-4686-ac5c-f0d6b6556dff tempest-AttachVolumeNegativeTest-394912296 None] Terminate volume connection completed successfully.
Sep 22 23:25:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-9423ee13-9362-490b-b912-8e5ce30ddbb3 req-a592328d-4f1a-4686-ac5c-f0d6b6556dff tempest-AttachVolumeNegativeTest-394912296 None] Deleting attachment 76bc43e6-121a-4eec-9ed6-cbb89f171d32. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:25:21 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:25:21 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:25:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Flow 'volume_create_manager' (e8107e30-761a-47f4-9c7c-5dddd14fc7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:25:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315b2af5-a003-4f4a-82a3-a0041626951f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:25:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315b2af5-a003-4f4a-82a3-a0041626951f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-613453165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79b45d6-8fd2-4ef7-80d2-99c18f860235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cc49a83bd884a9cae93b38c0b5dad65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:25:20Z,use_quota=True,user_id='826d9c400004481fa8493beccf334709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:25:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (919922f4-b624-4fee-9894-426ca40cfa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:25:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (919922f4-b624-4fee-9894-426ca40cfa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:25:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae2badd-8fab-41ea-ab13-300e85d54e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:25:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae2badd-8fab-41ea-ab13-300e85d54e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f79b45d6-8fd2-4ef7-80d2-99c18f860235', 'volume_name': 'volume-f79b45d6-8fd2-4ef7-80d2-99c18f860235', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:25:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b952a82-d13c-4203-a70e-5028b677b2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:25:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b952a82-d13c-4203-a70e-5028b677b2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:25:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b6224f-2465-4b9f-a4c9-9f6175388a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:25:22 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Volume f79b45d6-8fd2-4ef7-80d2-99c18f860235: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f79b45d6-8fd2-4ef7-80d2-99c18f860235', 'volume_size': 1}
Sep 22 23:25:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:25:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:25:22 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-613453165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79b45d6-8fd2-4ef7-80d2-99c18f860235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cc49a83bd884a9cae93b38c0b5dad65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:25:20Z,use_quota=True,user_id='826d9c400004481fa8493beccf334709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:25:22 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Creating volume f79b45d6-8fd2-4ef7-80d2-99c18f860235 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:25:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:25:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:25:22 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:25:22 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:25:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:25:22 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:25:22 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:25:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f79b45d6-8fd2-4ef7-80d2-99c18f860235 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:25:22 devstack quobyte-client[84065]: System call of process 93092 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:25:22 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=50, name=volume-f79b45d6-8fd2-4ef7-80d2-99c18f860235, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:25:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f79b45d6-8fd2-4ef7-80d2-99c18f860235 1073741824" returned: 0 in 0.559s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:25:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f79b45d6-8fd2-4ef7-80d2-99c18f860235 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:25:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f79b45d6-8fd2-4ef7-80d2-99c18f860235" returned: 0 in 0.348s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:25:23 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] <== create_volume: return (1318ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:25:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:25:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b6224f-2465-4b9f-a4c9-9f6175388a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f79b45d6-8fd2-4ef7-80d2-99c18f860235', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:25:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3229e6cb-fe38-41b9-9dce-ed06ddac217b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:25:24 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Volume volume-f79b45d6-8fd2-4ef7-80d2-99c18f860235 (f79b45d6-8fd2-4ef7-80d2-99c18f860235): created successfully
Sep 22 23:25:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3229e6cb-fe38-41b9-9dce-ed06ddac217b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:25:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Flow 'volume_create_manager' (e8107e30-761a-47f4-9c7c-5dddd14fc7c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:25:25 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-94969c0e-c010-4eac-b7a7-3cc71b54eb7b tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Created volume successfully.
Sep 22 23:25:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-58a32e75-e5d6-4e74-a434-b90b3f371253 req-672edf89-f4af-4901-87b9-c8dfe8793dd3 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:25:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-58a32e75-e5d6-4e74-a434-b90b3f371253 req-672edf89-f4af-4901-87b9-c8dfe8793dd3 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:25:32 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cca25d7-199b-49e5-b024-b95c571218cd]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:25:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-58a32e75-e5d6-4e74-a434-b90b3f371253 req-672edf89-f4af-4901-87b9-c8dfe8793dd3 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f79b45d6-8fd2-4ef7-80d2-99c18f860235 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:25:33 devstack quobyte-client[84065]: System call of process 93157 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:25:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-58a32e75-e5d6-4e74-a434-b90b3f371253 req-672edf89-f4af-4901-87b9-c8dfe8793dd3 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f79b45d6-8fd2-4ef7-80d2-99c18f860235" returned: 0 in 1.011s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:25:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-58a32e75-e5d6-4e74-a434-b90b3f371253 req-672edf89-f4af-4901-87b9-c8dfe8793dd3 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.145s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:25:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-58a32e75-e5d6-4e74-a434-b90b3f371253 req-672edf89-f4af-4901-87b9-c8dfe8793dd3 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-f79b45d6-8fd2-4ef7-80d2-99c18f860235', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3e0835c-f01c-4d21-95de-6954df12bbb4', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:25:33 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-58a32e75-e5d6-4e74-a434-b90b3f371253 req-672edf89-f4af-4901-87b9-c8dfe8793dd3 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:25:34 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-58a32e75-e5d6-4e74-a434-b90b3f371253 req-672edf89-f4af-4901-87b9-c8dfe8793dd3 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] attachment_update completed successfully.
Sep 22 23:25:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-701cd7c1-9c39-4047-bd4a-56cbe40086d6 tempest-AttachVolumeNegativeTest-394912296 None] Acquiring lock "cinder-733dd659-2662-4b8b-be1e-5d6980d0973f-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:25:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-701cd7c1-9c39-4047-bd4a-56cbe40086d6 tempest-AttachVolumeNegativeTest-394912296 None] Lock "cinder-733dd659-2662-4b8b-be1e-5d6980d0973f-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:25:37 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-701cd7c1-9c39-4047-bd4a-56cbe40086d6 tempest-AttachVolumeNegativeTest-394912296 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:25:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-701cd7c1-9c39-4047-bd4a-56cbe40086d6 tempest-AttachVolumeNegativeTest-394912296 None] Acquiring lock "cinder-quobyte-733dd659-2662-4b8b-be1e-5d6980d0973f" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:25:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-701cd7c1-9c39-4047-bd4a-56cbe40086d6 tempest-AttachVolumeNegativeTest-394912296 None] Lock "cinder-quobyte-733dd659-2662-4b8b-be1e-5d6980d0973f" acquired by "delete_volume" :: waited 0.016s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:25:37 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[051c35bb-d3fa-4fcd-81b4-ca46c8cb1bb2]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:25:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-701cd7c1-9c39-4047-bd4a-56cbe40086d6 tempest-AttachVolumeNegativeTest-394912296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-733dd659-2662-4b8b-be1e-5d6980d0973f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:25:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-701cd7c1-9c39-4047-bd4a-56cbe40086d6 tempest-AttachVolumeNegativeTest-394912296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-733dd659-2662-4b8b-be1e-5d6980d0973f" returned: 0 in 0.483s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:25:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-701cd7c1-9c39-4047-bd4a-56cbe40086d6 tempest-AttachVolumeNegativeTest-394912296 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-733dd659-2662-4b8b-be1e-5d6980d0973f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:25:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-701cd7c1-9c39-4047-bd4a-56cbe40086d6 tempest-AttachVolumeNegativeTest-394912296 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-733dd659-2662-4b8b-be1e-5d6980d0973f" returned: 0 in 0.136s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:25:38 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-701cd7c1-9c39-4047-bd4a-56cbe40086d6 tempest-AttachVolumeNegativeTest-394912296 None] Lock "cinder-quobyte-733dd659-2662-4b8b-be1e-5d6980d0973f" released by "delete_volume" :: held 0.808s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:25:38 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-701cd7c1-9c39-4047-bd4a-56cbe40086d6 tempest-AttachVolumeNegativeTest-394912296 None] Created reservations ['1f7ef50d-65f3-4527-a863-92f1d22bbc13', '7b7de82e-4bd2-4736-b613-7d6d1a30b3ae', '11fbe72f-ce3f-443b-98fd-1a2204de9dd7', '60bd0994-3c00-47e8-9d8f-f57ccb6d9c66'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:25:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-701cd7c1-9c39-4047-bd4a-56cbe40086d6 tempest-AttachVolumeNegativeTest-394912296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:25:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-701cd7c1-9c39-4047-bd4a-56cbe40086d6 tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:25:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-701cd7c1-9c39-4047-bd4a-56cbe40086d6 tempest-AttachVolumeNegativeTest-394912296 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:25:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-701cd7c1-9c39-4047-bd4a-56cbe40086d6 tempest-AttachVolumeNegativeTest-394912296 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:25:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-701cd7c1-9c39-4047-bd4a-56cbe40086d6 tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:25:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-701cd7c1-9c39-4047-bd4a-56cbe40086d6 tempest-AttachVolumeNegativeTest-394912296 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:25:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-701cd7c1-9c39-4047-bd4a-56cbe40086d6 tempest-AttachVolumeNegativeTest-394912296 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.092s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:25:39 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-701cd7c1-9c39-4047-bd4a-56cbe40086d6 tempest-AttachVolumeNegativeTest-394912296 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:25:39 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-701cd7c1-9c39-4047-bd4a-56cbe40086d6 tempest-AttachVolumeNegativeTest-394912296 None] Deleted volume successfully.
Sep 22 23:25:39 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-701cd7c1-9c39-4047-bd4a-56cbe40086d6 tempest-AttachVolumeNegativeTest-394912296 None] Lock "cinder-733dd659-2662-4b8b-be1e-5d6980d0973f-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:25:40 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ea2c4161-9793-48f9-a28f-8ba1bfa683e3 tempest-AttachVolumeNegativeTest-394912296 None] Acquiring lock "cinder-5d3f9b36-a814-40e1-bfec-5322fb16358e-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:25:40 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ea2c4161-9793-48f9-a28f-8ba1bfa683e3 tempest-AttachVolumeNegativeTest-394912296 None] Lock "cinder-5d3f9b36-a814-40e1-bfec-5322fb16358e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:25:40 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-ea2c4161-9793-48f9-a28f-8ba1bfa683e3 tempest-AttachVolumeNegativeTest-394912296 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:25:40 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ea2c4161-9793-48f9-a28f-8ba1bfa683e3 tempest-AttachVolumeNegativeTest-394912296 None] Acquiring lock "cinder-quobyte-5d3f9b36-a814-40e1-bfec-5322fb16358e" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:25:40 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ea2c4161-9793-48f9-a28f-8ba1bfa683e3 tempest-AttachVolumeNegativeTest-394912296 None] Lock "cinder-quobyte-5d3f9b36-a814-40e1-bfec-5322fb16358e" acquired by "delete_volume" :: waited 0.082s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:25:40 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2382c1-0485-4e50-be2d-ece948b00945]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:25:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ea2c4161-9793-48f9-a28f-8ba1bfa683e3 tempest-AttachVolumeNegativeTest-394912296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d3f9b36-a814-40e1-bfec-5322fb16358e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:25:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ea2c4161-9793-48f9-a28f-8ba1bfa683e3 tempest-AttachVolumeNegativeTest-394912296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d3f9b36-a814-40e1-bfec-5322fb16358e" returned: 0 in 0.699s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:25:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ea2c4161-9793-48f9-a28f-8ba1bfa683e3 tempest-AttachVolumeNegativeTest-394912296 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d3f9b36-a814-40e1-bfec-5322fb16358e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:25:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ea2c4161-9793-48f9-a28f-8ba1bfa683e3 tempest-AttachVolumeNegativeTest-394912296 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d3f9b36-a814-40e1-bfec-5322fb16358e" returned: 0 in 0.208s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:25:41 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ea2c4161-9793-48f9-a28f-8ba1bfa683e3 tempest-AttachVolumeNegativeTest-394912296 None] Lock "cinder-quobyte-5d3f9b36-a814-40e1-bfec-5322fb16358e" released by "delete_volume" :: held 1.231s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:25:42 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-ea2c4161-9793-48f9-a28f-8ba1bfa683e3 tempest-AttachVolumeNegativeTest-394912296 None] Created reservations ['5970a7cf-3f3a-473e-adb9-0c4e81bb3475', '29061fd3-4db7-4fbc-9a6f-a81ade11f6a9', 'fedd92ec-aca4-438f-a854-c9925361d285', 'a35fcced-f70c-4c87-b3ee-31b17d246688'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:25:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ea2c4161-9793-48f9-a28f-8ba1bfa683e3 tempest-AttachVolumeNegativeTest-394912296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:25:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ea2c4161-9793-48f9-a28f-8ba1bfa683e3 tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:25:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ea2c4161-9793-48f9-a28f-8ba1bfa683e3 tempest-AttachVolumeNegativeTest-394912296 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:25:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ea2c4161-9793-48f9-a28f-8ba1bfa683e3 tempest-AttachVolumeNegativeTest-394912296 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:25:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ea2c4161-9793-48f9-a28f-8ba1bfa683e3 tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:25:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ea2c4161-9793-48f9-a28f-8ba1bfa683e3 tempest-AttachVolumeNegativeTest-394912296 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:25:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ea2c4161-9793-48f9-a28f-8ba1bfa683e3 tempest-AttachVolumeNegativeTest-394912296 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.138s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:25:42 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-ea2c4161-9793-48f9-a28f-8ba1bfa683e3 tempest-AttachVolumeNegativeTest-394912296 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:25:42 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-ea2c4161-9793-48f9-a28f-8ba1bfa683e3 tempest-AttachVolumeNegativeTest-394912296 None] Deleted volume successfully.
Sep 22 23:25:43 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-eba9d85d-9688-4347-907f-3793341f2575 tempest-AttachVolumeNegativeTest-394912296 None] Acquiring lock "cinder-c73b74c7-df61-4edf-97fb-262ed53af302-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:25:43 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ea2c4161-9793-48f9-a28f-8ba1bfa683e3 tempest-AttachVolumeNegativeTest-394912296 None] Lock "cinder-5d3f9b36-a814-40e1-bfec-5322fb16358e-delete_volume" released by "delete_volume" :: held 3.040s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:25:43 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-eba9d85d-9688-4347-907f-3793341f2575 tempest-AttachVolumeNegativeTest-394912296 None] Lock "cinder-c73b74c7-df61-4edf-97fb-262ed53af302-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:25:43 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-eba9d85d-9688-4347-907f-3793341f2575 tempest-AttachVolumeNegativeTest-394912296 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:25:43 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-eba9d85d-9688-4347-907f-3793341f2575 tempest-AttachVolumeNegativeTest-394912296 None] Acquiring lock "cinder-quobyte-c73b74c7-df61-4edf-97fb-262ed53af302" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:25:43 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-eba9d85d-9688-4347-907f-3793341f2575 tempest-AttachVolumeNegativeTest-394912296 None] Lock "cinder-quobyte-c73b74c7-df61-4edf-97fb-262ed53af302" acquired by "delete_volume" :: waited 0.023s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:25:43 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b873eb-d6c3-4de1-b2db-a3915bd6d43c]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:25:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-eba9d85d-9688-4347-907f-3793341f2575 tempest-AttachVolumeNegativeTest-394912296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c73b74c7-df61-4edf-97fb-262ed53af302 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:25:44 devstack quobyte-client[84065]: System call of process 93587 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:25:44 devstack quobyte-client[84065]: System call of process 93587 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:25:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-eba9d85d-9688-4347-907f-3793341f2575 tempest-AttachVolumeNegativeTest-394912296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c73b74c7-df61-4edf-97fb-262ed53af302" returned: 0 in 0.640s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:25:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-eba9d85d-9688-4347-907f-3793341f2575 tempest-AttachVolumeNegativeTest-394912296 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c73b74c7-df61-4edf-97fb-262ed53af302 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:25:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-eba9d85d-9688-4347-907f-3793341f2575 tempest-AttachVolumeNegativeTest-394912296 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c73b74c7-df61-4edf-97fb-262ed53af302" returned: 0 in 0.179s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:25:44 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-eba9d85d-9688-4347-907f-3793341f2575 tempest-AttachVolumeNegativeTest-394912296 None] Lock "cinder-quobyte-c73b74c7-df61-4edf-97fb-262ed53af302" released by "delete_volume" :: held 1.062s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:25:45 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-eba9d85d-9688-4347-907f-3793341f2575 tempest-AttachVolumeNegativeTest-394912296 None] Created reservations ['fc143ba0-e13d-4ae8-98f3-69b89e73e79f', '7ed711ef-2838-4b79-acb8-a268d07c6a3e', 'c4413f38-a6d5-4e4f-9ac7-7c41d8a64387', 'f3bf04f1-2fba-4349-a3df-47b7fe51b3b6'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:25:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-eba9d85d-9688-4347-907f-3793341f2575 tempest-AttachVolumeNegativeTest-394912296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:25:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-eba9d85d-9688-4347-907f-3793341f2575 tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:25:45 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-eba9d85d-9688-4347-907f-3793341f2575 tempest-AttachVolumeNegativeTest-394912296 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:25:45 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-eba9d85d-9688-4347-907f-3793341f2575 tempest-AttachVolumeNegativeTest-394912296 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:25:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-eba9d85d-9688-4347-907f-3793341f2575 tempest-AttachVolumeNegativeTest-394912296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:25:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-eba9d85d-9688-4347-907f-3793341f2575 tempest-AttachVolumeNegativeTest-394912296 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:25:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-eba9d85d-9688-4347-907f-3793341f2575 tempest-AttachVolumeNegativeTest-394912296 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.144s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:25:45 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-eba9d85d-9688-4347-907f-3793341f2575 tempest-AttachVolumeNegativeTest-394912296 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:25:45 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-eba9d85d-9688-4347-907f-3793341f2575 tempest-AttachVolumeNegativeTest-394912296 None] Deleted volume successfully.
Sep 22 23:25:45 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-eba9d85d-9688-4347-907f-3793341f2575 tempest-AttachVolumeNegativeTest-394912296 None] Lock "cinder-c73b74c7-df61-4edf-97fb-262ed53af302-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:25:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:25:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:25:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:25:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:25:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:25:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:25:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:25:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.286s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:25:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:25:55 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=24,cinder:UPDATE=32,cinder:DELETE=3,cinder:INSERT=8 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:25:55 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=21,cinder:UPDATE=23,cinder:INSERT=4,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:25:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5084ce2f-00d9-4d17-95fb-304be90633ee tempest-BackendsCapabilitiesAdminTestsJSON-1899276223 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154739379883, 'free_capacity_gb': 924.9154739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84012) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 22 23:25:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c984087a-322d-4d23-a79f-66aef1936db1 tempest-BackendsCapabilitiesAdminTestsJSON-1899276223 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154739379883, 'free_capacity_gb': 924.9154739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84012) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 22 23:26:04 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-d13dbd66-00b7-4351-8ee9-10058e883ff7 tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:26:04 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-d13dbd66-00b7-4351-8ee9-10058e883ff7 tempest-GroupSnapshotsTest-769551106 None] Group tempest-GroupSnapshotsTest-Group-2027393033: creating
Sep 22 23:26:04 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-d13dbd66-00b7-4351-8ee9-10058e883ff7 tempest-GroupSnapshotsTest-769551106 None] Group tempest-GroupSnapshotsTest-Group-2027393033: created successfully
Sep 22 23:26:04 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-d13dbd66-00b7-4351-8ee9-10058e883ff7 tempest-GroupSnapshotsTest-769551106 None] Create group completed successfully.
Sep 22 23:26:05 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-7701b925-a70a-4daa-b410-0077c76f5f8b req-47312637-5802-42a6-a35a-ef2c524c1479 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:26:05 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-7701b925-a70a-4daa-b410-0077c76f5f8b req-47312637-5802-42a6-a35a-ef2c524c1479 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:26:05 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-7701b925-a70a-4daa-b410-0077c76f5f8b req-47312637-5802-42a6-a35a-ef2c524c1479 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Terminate volume connection completed successfully.
Sep 22 23:26:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-7701b925-a70a-4daa-b410-0077c76f5f8b req-47312637-5802-42a6-a35a-ef2c524c1479 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Deleting attachment f3e0835c-f01c-4d21-95de-6954df12bbb4. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:26:05 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:26:05 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:26:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Flow 'volume_create_manager' (06f207d2-689b-41b3-8d9e-032e1025355d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:26:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb6e4d0c-9212-4e76-8bf3-8d6e990db5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb6e4d0c-9212-4e76-8bf3-8d6e990db5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-320594240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ca72ef33-20cd-430d-ad1c-1e494139031f,host='devstack@QuobyteHD#QuobyteHD',id=3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a13239a679466ca7d8470c0e3f8f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:26:06Z,use_quota=True,user_id='cb6daa2f88c448cab1e52efd52fa2aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b3480f2-0126-4a9c-a812-439c8b26614e),volume_type_id=5b3480f2-0126-4a9c-a812-439c8b26614e)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8849cec8-63b2-4195-8b45-aeacc5b86fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8849cec8-63b2-4195-8b45-aeacc5b86fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7593e3d-1cf5-4264-9229-616268471c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7593e3d-1cf5-4264-9229-616268471c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb', 'volume_name': 'volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e34fd0-4ca5-4544-870e-77cb5f720dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e34fd0-4ca5-4544-870e-77cb5f720dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84230289-cdc7-43da-b73d-1555dcee0884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:06 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Volume 3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb', 'volume_size': 1}
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ca72ef33-20cd-430d-ad1c-1e494139031f,created_at=2025-09-22T21:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-320594240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ca72ef33-20cd-430d-ad1c-1e494139031f,host='devstack@QuobyteHD#QuobyteHD',id=3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a13239a679466ca7d8470c0e3f8f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:26:06Z,use_quota=True,user_id='cb6daa2f88c448cab1e52efd52fa2aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b3480f2-0126-4a9c-a812-439c8b26614e),volume_type_id=5b3480f2-0126-4a9c-a812-439c8b26614e)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Creating volume 3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:26:06 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:06 devstack quobyte-client[84065]: System call of process 93668 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:06 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=51, name=volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb 1073741824" returned: 0 in 0.465s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb" returned: 0 in 0.128s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] <== create_volume: return (674ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84230289-cdc7-43da-b73d-1555dcee0884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4f388a-a150-42ae-8f96-b4321f6ff5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:07 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Volume volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb (3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb): created successfully
Sep 22 23:26:07 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4f388a-a150-42ae-8f96-b4321f6ff5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:07 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Flow 'volume_create_manager' (06f207d2-689b-41b3-8d9e-032e1025355d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:26:07 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-0ec2e5e0-fa75-4c71-b9d5-fbd9918e8287 tempest-GroupSnapshotsTest-769551106 None] Created volume successfully.
Sep 22 23:26:07 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-10542b42-22c1-474c-bc3c-4db9e0c2ee93 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Acquiring lock "cinder-f79b45d6-8fd2-4ef7-80d2-99c18f860235-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:26:07 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-10542b42-22c1-474c-bc3c-4db9e0c2ee93 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Lock "cinder-f79b45d6-8fd2-4ef7-80d2-99c18f860235-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:26:07 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-10542b42-22c1-474c-bc3c-4db9e0c2ee93 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:26:07 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-10542b42-22c1-474c-bc3c-4db9e0c2ee93 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Acquiring lock "cinder-quobyte-f79b45d6-8fd2-4ef7-80d2-99c18f860235" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:26:07 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-10542b42-22c1-474c-bc3c-4db9e0c2ee93 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Lock "cinder-quobyte-f79b45d6-8fd2-4ef7-80d2-99c18f860235" acquired by "delete_volume" :: waited 0.016s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:26:07 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf84f835-2ca1-4bf1-ac02-250a432cdaa0]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:26:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-10542b42-22c1-474c-bc3c-4db9e0c2ee93 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f79b45d6-8fd2-4ef7-80d2-99c18f860235 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-10542b42-22c1-474c-bc3c-4db9e0c2ee93 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f79b45d6-8fd2-4ef7-80d2-99c18f860235" returned: 0 in 0.571s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-10542b42-22c1-474c-bc3c-4db9e0c2ee93 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f79b45d6-8fd2-4ef7-80d2-99c18f860235 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:08 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] GroupSnapshot 7335c145-329f-4828-addb-8abc347a7c55: creating.
Sep 22 23:26:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-10542b42-22c1-474c-bc3c-4db9e0c2ee93 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f79b45d6-8fd2-4ef7-80d2-99c18f860235" returned: 0 in 0.517s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:09 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:26:09 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] Group snapshot 7335c145-329f-4828-addb-8abc347a7c55: creating. {{(pid=84012) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 22 23:26:09 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-10542b42-22c1-474c-bc3c-4db9e0c2ee93 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Lock "cinder-quobyte-f79b45d6-8fd2-4ef7-80d2-99c18f860235" released by "delete_volume" :: held 1.269s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:26:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:26:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:26:09 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] Creating offline snapshot 2323cc79-f30f-42e9-a1a6-8d03369c95eb of volume 3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:26:09 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-10542b42-22c1-474c-bc3c-4db9e0c2ee93 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Created reservations ['4ec248f1-8739-4717-a41b-9e72831f7a3e', 'c115cff8-4fbe-493c-89bf-3ff5c09d2642', 'ecc2f6b7-662e-444a-adfa-039bccd4152b', '86e777fe-d57e-46e7-9d10-b4931038a3fb'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:26:09 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ad3d11-5696-4ae5-a633-9b1fab4ab433]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:26:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-10542b42-22c1-474c-bc3c-4db9e0c2ee93 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:26:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-10542b42-22c1-474c-bc3c-4db9e0c2ee93 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.058s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:26:09 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-10542b42-22c1-474c-bc3c-4db9e0c2ee93 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:26:09 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-10542b42-22c1-474c-bc3c-4db9e0c2ee93 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:26:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-10542b42-22c1-474c-bc3c-4db9e0c2ee93 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:26:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-10542b42-22c1-474c-bc3c-4db9e0c2ee93 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:09 devstack quobyte-client[84065]: System call of process 93676 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb" returned: 0 in 0.913s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.2323cc79-f30f-42e9-a1a6-8d03369c95eb 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:10 devstack quobyte-client[84065]: System call of process 93683 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-10542b42-22c1-474c-bc3c-4db9e0c2ee93 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.611s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:10 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=52, name=volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.2323cc79-f30f-42e9-a1a6-8d03369c95eb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:26:10 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-10542b42-22c1-474c-bc3c-4db9e0c2ee93 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:26:10 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-10542b42-22c1-474c-bc3c-4db9e0c2ee93 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Deleted volume successfully.
Sep 22 23:26:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.2323cc79-f30f-42e9-a1a6-8d03369c95eb 1G" returned: 0 in 0.621s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.2323cc79-f30f-42e9-a1a6-8d03369c95eb {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:11 devstack quobyte-client[84065]: System call of process 93689 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:11 devstack quobyte-client[84065]: System call of process 93689 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:11 devstack quobyte-client[84065]: System call of process 93689 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:11 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-10542b42-22c1-474c-bc3c-4db9e0c2ee93 tempest-TestServerVolumeAttachScenarioOldVersion-617865148 None] Lock "cinder-f79b45d6-8fd2-4ef7-80d2-99c18f860235-delete_volume" released by "delete_volume" :: held 3.477s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:26:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] CMD "qemu-img rebase -u -b volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.2323cc79-f30f-42e9-a1a6-8d03369c95eb" returned: 0 in 0.354s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:11 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.2323cc79-f30f-42e9-a1a6-8d03369c95eb is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:26:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.2323cc79-f30f-42e9-a1a6-8d03369c95eb {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.2323cc79-f30f-42e9-a1a6-8d03369c95eb" returned: 0 in 0.096s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:11 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:26:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.2323cc79-f30f-42e9-a1a6-8d03369c95eb {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.2323cc79-f30f-42e9-a1a6-8d03369c95eb" returned: 0 in 0.333s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.info" returned: 0 in 0.444s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:12 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.info is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:26:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.info" returned: 0 in 0.857s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.310s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:26:14 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Flow 'volume_create_manager' (8802ae9d-dbf1-4f51-ad1f-85b2f78be8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327c515c-fde0-4ca3-a8d3-116542da01b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327c515c-fde0-4ca3-a8d3-116542da01b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-67319590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e99834f-b8b0-41a5-a78c-0d025d89fb91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d292b4ecb74117b122728be5976e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:26:13Z,use_quota=True,user_id='9d89dd62c2ef43daa5145ce3cddd10a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5bdcf09-1a05-4ad8-8f24-45e213bd3fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5bdcf09-1a05-4ad8-8f24-45e213bd3fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee62d7a-7d99-4a83-aa84-61b6975b8709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee62d7a-7d99-4a83-aa84-61b6975b8709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e99834f-b8b0-41a5-a78c-0d025d89fb91', 'volume_name': 'volume-7e99834f-b8b0-41a5-a78c-0d025d89fb91', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae62016-50d2-46ef-bd17-c4fbd9d27d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae62016-50d2-46ef-bd17-c4fbd9d27d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f60fb8-c6b1-4d0a-aa83-5606fc919372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:14 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Volume 7e99834f-b8b0-41a5-a78c-0d025d89fb91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e99834f-b8b0-41a5-a78c-0d025d89fb91', 'volume_size': 1}
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-67319590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e99834f-b8b0-41a5-a78c-0d025d89fb91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d292b4ecb74117b122728be5976e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:26:13Z,use_quota=True,user_id='9d89dd62c2ef43daa5145ce3cddd10a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Creating volume 7e99834f-b8b0-41a5-a78c-0d025d89fb91 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:26:14 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:26:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7e99834f-b8b0-41a5-a78c-0d025d89fb91 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:14 devstack quobyte-client[84065]: System call of process 93736 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:14 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=54, name=volume-7e99834f-b8b0-41a5-a78c-0d025d89fb91, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:26:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7e99834f-b8b0-41a5-a78c-0d025d89fb91 1073741824" returned: 0 in 0.828s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7e99834f-b8b0-41a5-a78c-0d025d89fb91 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7e99834f-b8b0-41a5-a78c-0d025d89fb91" returned: 0 in 0.684s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] <== create_volume: return (1736ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:26:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:26:16 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-e8f4a044-cbe3-4fe1-97c8-ee42981594f3 tempest-GroupSnapshotsTest-769551106 None] group_snapshot 7335c145-329f-4828-addb-8abc347a7c55: created successfully
Sep 22 23:26:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f60fb8-c6b1-4d0a-aa83-5606fc919372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e99834f-b8b0-41a5-a78c-0d025d89fb91', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf57351-df38-4cd9-8d44-edf67be92cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:16 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Volume volume-7e99834f-b8b0-41a5-a78c-0d025d89fb91 (7e99834f-b8b0-41a5-a78c-0d025d89fb91): created successfully
Sep 22 23:26:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf57351-df38-4cd9-8d44-edf67be92cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Flow 'volume_create_manager' (8802ae9d-dbf1-4f51-ad1f-85b2f78be8d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:26:17 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-0e647fa1-0562-43a0-9131-08b339d6a9bb tempest-AttachVolumeTestJSON-1520125212 None] Created volume successfully.
Sep 22 23:26:19 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "cinder-quobyte-2323cc79-f30f-42e9-a1a6-8d03369c95eb-c371a2fc-3d8c-4050-88f7-9f0f9f0073bf" by "_create_volume_from_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-2323cc79-f30f-42e9-a1a6-8d03369c95eb-c371a2fc-3d8c-4050-88f7-9f0f9f0073bf" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Creating volume c371a2fc-3d8c-4050-88f7-9f0f9f0073bf from snapshot 2323cc79-f30f-42e9-a1a6-8d03369c95eb {{(pid=84012) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "cinder-quobyte-c371a2fc-3d8c-4050-88f7-9f0f9f0073bf" by "_copy_volume_from_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-c371a2fc-3d8c-4050-88f7-9f0f9f0073bf" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] snapshot: 2323cc79-f30f-42e9-a1a6-8d03369c95eb, volume: c371a2fc-3d8c-4050-88f7-9f0f9f0073bf,  {{(pid=84012) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1145de82-f7ba-4631-b75e-5dd00ae976c5]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.2323cc79-f30f-42e9-a1a6-8d03369c95eb {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.2323cc79-f30f-42e9-a1a6-8d03369c95eb" returned: 0 in 0.478s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb {{(pid=84012) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Creating direct copy from snapshot {{(pid=84012) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[40410f8c-0608-452a-bc15-21037a5eb9b7]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:26:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:20 devstack quobyte-client[84065]: System call of process 93745 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb" returned: 0 in 0.448s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:20 devstack cinder-volume[84012]: DEBUG cinder.utils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c371a2fc-3d8c-4050-88f7-9f0f9f0073bf not found in is_blk_device check {{(pid=84012) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 22 23:26:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c371a2fc-3d8c-4050-88f7-9f0f9f0073bf {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:20 devstack quobyte-client[84065]: System call of process 93748 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:20 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=55, name=volume-c371a2fc-3d8c-4050-88f7-9f0f9f0073bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:26:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-7a231ec4-7ece-401f-8416-409823121f7c req-2fcf41ae-6eda-4625-8ba2-a629c684a4bc tempest-AttachVolumeTestJSON-1520125212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:26:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c371a2fc-3d8c-4050-88f7-9f0f9f0073bf" returned: 0 in 8.473s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:28 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b41a83e-9045-4a86-bb88-70261a7bfe8f]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:26:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:29 devstack quobyte-client[84065]: System call of process 93816 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:29 devstack quobyte-client[84065]: System call of process 93816 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:29 devstack quobyte-client[84065]: System call of process 93816 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:29 devstack quobyte-client[84065]: System call of process 93816 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:29 devstack quobyte-client[84065]: System call of process 93816 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb" returned: 0 in 0.937s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:29 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Image conversion details: src /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb, size 1024.00 MB, duration 8.48 sec, destination /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c371a2fc-3d8c-4050-88f7-9f0f9f0073bf {{(pid=84012) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 22 23:26:29 devstack cinder-volume[84012]: INFO cinder.image.image_utils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Converted 1024.00 MB image at 120.80 MB/s
Sep 22 23:26:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c371a2fc-3d8c-4050-88f7-9f0f9f0073bf is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:26:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c371a2fc-3d8c-4050-88f7-9f0f9f0073bf {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c371a2fc-3d8c-4050-88f7-9f0f9f0073bf" returned: 0 in 0.168s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:30 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-c371a2fc-3d8c-4050-88f7-9f0f9f0073bf" released by "_copy_volume_from_snapshot" :: held 10.969s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:26:30 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-2323cc79-f30f-42e9-a1a6-8d03369c95eb-c371a2fc-3d8c-4050-88f7-9f0f9f0073bf" released by "_create_volume_from_snapshot" :: held 11.024s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:26:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.087s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:26:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-7a231ec4-7ece-401f-8416-409823121f7c req-2fcf41ae-6eda-4625-8ba2-a629c684a4bc tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.961s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:26:30 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea9f30b-df0c-4f1f-8832-ed249204595d]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:26:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-7a231ec4-7ece-401f-8416-409823121f7c req-2fcf41ae-6eda-4625-8ba2-a629c684a4bc tempest-AttachVolumeTestJSON-1520125212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7e99834f-b8b0-41a5-a78c-0d025d89fb91 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:31 devstack quobyte-client[84065]: System call of process 93824 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:31 devstack quobyte-client[84065]: System call of process 93824 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:31 devstack quobyte-client[84065]: System call of process 93824 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:31 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-ed11ec16-bde0-4ae3-8c23-6567d72f7bc5 tempest-GroupSnapshotsTest-769551106 None] Create group from source-snapshot-7335c145-329f-4828-addb-8abc347a7c55 completed successfully.
Sep 22 23:26:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-7a231ec4-7ece-401f-8416-409823121f7c req-2fcf41ae-6eda-4625-8ba2-a629c684a4bc tempest-AttachVolumeTestJSON-1520125212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7e99834f-b8b0-41a5-a78c-0d025d89fb91" returned: 0 in 1.210s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-7a231ec4-7ece-401f-8416-409823121f7c req-2fcf41ae-6eda-4625-8ba2-a629c684a4bc tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.261s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:26:31 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-7a231ec4-7ece-401f-8416-409823121f7c req-2fcf41ae-6eda-4625-8ba2-a629c684a4bc tempest-AttachVolumeTestJSON-1520125212 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-7e99834f-b8b0-41a5-a78c-0d025d89fb91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8535df6-927c-45e7-bdc7-67f4a74b2949', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:26:31 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-7a231ec4-7ece-401f-8416-409823121f7c req-2fcf41ae-6eda-4625-8ba2-a629c684a4bc tempest-AttachVolumeTestJSON-1520125212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:26:31 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-7a231ec4-7ece-401f-8416-409823121f7c req-2fcf41ae-6eda-4625-8ba2-a629c684a4bc tempest-AttachVolumeTestJSON-1520125212 None] attachment_update completed successfully.
Sep 22 23:26:32 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-c96ee744-4e35-4dcd-b884-f22dd517e55f tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:26:32 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c96ee744-4e35-4dcd-b884-f22dd517e55f tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "cinder-quobyte-c371a2fc-3d8c-4050-88f7-9f0f9f0073bf" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:26:32 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c96ee744-4e35-4dcd-b884-f22dd517e55f tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-c371a2fc-3d8c-4050-88f7-9f0f9f0073bf" acquired by "delete_volume" :: waited 0.110s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:26:32 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a58ebb-9ff7-47fa-9c7c-1b800799c616]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:26:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c96ee744-4e35-4dcd-b884-f22dd517e55f tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c371a2fc-3d8c-4050-88f7-9f0f9f0073bf {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c96ee744-4e35-4dcd-b884-f22dd517e55f tempest-GroupSnapshotsTest-769551106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c371a2fc-3d8c-4050-88f7-9f0f9f0073bf" returned: 0 in 1.007s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c96ee744-4e35-4dcd-b884-f22dd517e55f tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c371a2fc-3d8c-4050-88f7-9f0f9f0073bf {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c96ee744-4e35-4dcd-b884-f22dd517e55f tempest-GroupSnapshotsTest-769551106 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c371a2fc-3d8c-4050-88f7-9f0f9f0073bf" returned: 0 in 0.215s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:34 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c96ee744-4e35-4dcd-b884-f22dd517e55f tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-c371a2fc-3d8c-4050-88f7-9f0f9f0073bf" released by "delete_volume" :: held 1.497s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:26:34 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-c96ee744-4e35-4dcd-b884-f22dd517e55f tempest-GroupSnapshotsTest-769551106 None] Created reservations ['291cdc72-e36a-45e5-a55c-e8549e8fa016'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:26:34 devstack cinder-volume[84012]: WARNING cinder.quota [None req-c96ee744-4e35-4dcd-b884-f22dd517e55f tempest-GroupSnapshotsTest-769551106 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1933600302 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1933600302, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:26:34 devstack cinder-volume[84012]: WARNING cinder.quota [None req-c96ee744-4e35-4dcd-b884-f22dd517e55f tempest-GroupSnapshotsTest-769551106 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1933600302 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1933600302, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:26:34 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-c96ee744-4e35-4dcd-b884-f22dd517e55f tempest-GroupSnapshotsTest-769551106 None] Created reservations ['5968c4ee-7dbc-493b-8046-4deec14b48e1', 'e7ba9f1f-ba37-4336-bb4a-ac6d5064b19d', 'fdc5d14b-a72c-43bf-a5d6-c4d254bf0da9', 'ed75ef53-6314-458f-8adf-5326e2988386'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:26:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c96ee744-4e35-4dcd-b884-f22dd517e55f tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:26:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c96ee744-4e35-4dcd-b884-f22dd517e55f tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:26:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c96ee744-4e35-4dcd-b884-f22dd517e55f tempest-GroupSnapshotsTest-769551106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:26:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c96ee744-4e35-4dcd-b884-f22dd517e55f tempest-GroupSnapshotsTest-769551106 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:26:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c96ee744-4e35-4dcd-b884-f22dd517e55f tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:26:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c96ee744-4e35-4dcd-b884-f22dd517e55f tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c96ee744-4e35-4dcd-b884-f22dd517e55f tempest-GroupSnapshotsTest-769551106 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.214s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:35 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-c96ee744-4e35-4dcd-b884-f22dd517e55f tempest-GroupSnapshotsTest-769551106 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:26:35 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-c96ee744-4e35-4dcd-b884-f22dd517e55f tempest-GroupSnapshotsTest-769551106 None] Delete group completed successfully.
Sep 22 23:26:36 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] group_snapshot 7335c145-329f-4828-addb-8abc347a7c55: deleting
Sep 22 23:26:36 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:26:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] group_snapshot 7335c145-329f-4828-addb-8abc347a7c55: deleting {{(pid=84012) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 22 23:26:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "cinder-quobyte-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:26:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb" acquired by "delete_snapshot" :: waited 0.057s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:26:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "cinder-quobyte-2323cc79-f30f-42e9-a1a6-8d03369c95eb" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:26:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-2323cc79-f30f-42e9-a1a6-8d03369c95eb" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:26:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] Deleting offline snapshot 2323cc79-f30f-42e9-a1a6-8d03369c95eb of volume 3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:26:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] snapshot_file for this snap is: volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.2323cc79-f30f-42e9-a1a6-8d03369c95eb {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:26:37 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a99faa-8714-4981-9b10-6baf9e56c1e8]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:26:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.2323cc79-f30f-42e9-a1a6-8d03369c95eb {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:37 devstack quobyte-client[84065]: System call of process 94225 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:37 devstack quobyte-client[84065]: System call of process 94225 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:37 devstack quobyte-client[84065]: System call of process 94225 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.2323cc79-f30f-42e9-a1a6-8d03369c95eb" returned: 0 in 0.464s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:26:37 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c05ca5-9566-4a29-ae4a-f21e5f3563ec]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:26:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:38 devstack quobyte-client[84065]: System call of process 94228 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb" returned: 0 in 0.593s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.2323cc79-f30f-42e9-a1a6-8d03369c95eb {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:38 devstack quobyte-client[84065]: System call of process 94231 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:38 devstack quobyte-client[84065]: System call of process 94231 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.2323cc79-f30f-42e9-a1a6-8d03369c95eb" returned: 0 in 0.256s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.2323cc79-f30f-42e9-a1a6-8d03369c95eb {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb.2323cc79-f30f-42e9-a1a6-8d03369c95eb" returned: 0 in 0.147s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:38 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-2323cc79-f30f-42e9-a1a6-8d03369c95eb" released by "_delete_snapshot" :: held 1.848s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:26:39 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb" released by "delete_snapshot" :: held 1.886s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:26:39 devstack cinder-volume[84012]: WARNING cinder.quota [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1933600302 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1933600302, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:26:39 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] Created reservations ['ee4a9730-a404-4375-a938-e6960bb33166', '82a4afc9-efce-4333-9229-83cd243186b9', '1662b144-11a9-49a6-b56f-8e188d0f4ca4', '14b3d2df-f730-46de-aa07-91d6a6cd8a8d'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:26:39 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-5ca2ea26-704f-4b96-8649-f33bf7dcf947 tempest-GroupSnapshotsTest-769551106 None] group_snapshot 7335c145-329f-4828-addb-8abc347a7c55: deleted successfully
Sep 22 23:26:40 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-3e0b01e2-3416-4972-bd61-15f7ad5ff11e tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:26:40 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3e0b01e2-3416-4972-bd61-15f7ad5ff11e tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "cinder-quobyte-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:26:40 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3e0b01e2-3416-4972-bd61-15f7ad5ff11e tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb" acquired by "delete_volume" :: waited 0.016s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:26:41 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[161b60e2-767a-4fb6-9b0d-83035214905e]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:26:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3e0b01e2-3416-4972-bd61-15f7ad5ff11e tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3e0b01e2-3416-4972-bd61-15f7ad5ff11e tempest-GroupSnapshotsTest-769551106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb" returned: 0 in 0.636s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3e0b01e2-3416-4972-bd61-15f7ad5ff11e tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3e0b01e2-3416-4972-bd61-15f7ad5ff11e tempest-GroupSnapshotsTest-769551106 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb" returned: 0 in 0.157s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:42 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3e0b01e2-3416-4972-bd61-15f7ad5ff11e tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-3bada3c2-bc1e-45f0-93e2-30a9bf3a0fdb" released by "delete_volume" :: held 1.047s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:26:42 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-3e0b01e2-3416-4972-bd61-15f7ad5ff11e tempest-GroupSnapshotsTest-769551106 None] Created reservations ['38b5c46f-10e0-434e-bb59-6245e0ee14ca'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:26:43 devstack cinder-volume[84012]: WARNING cinder.db.sqlalchemy.api [None req-3e0b01e2-3416-4972-bd61-15f7ad5ff11e tempest-GroupSnapshotsTest-769551106 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1933600302']
Sep 22 23:26:43 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-3e0b01e2-3416-4972-bd61-15f7ad5ff11e tempest-GroupSnapshotsTest-769551106 None] Created reservations ['ade45c46-6e66-4fbf-b6f5-be1afb6a572f', 'd86075fe-5c6f-41da-98e9-8fe3cbe145b4', 'a26c540c-9ddf-408d-84d9-d20bbe6e17f7', '1d8c66be-520a-4eed-8355-0f87815d5121'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:26:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3e0b01e2-3416-4972-bd61-15f7ad5ff11e tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:26:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3e0b01e2-3416-4972-bd61-15f7ad5ff11e tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:26:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3e0b01e2-3416-4972-bd61-15f7ad5ff11e tempest-GroupSnapshotsTest-769551106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:26:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3e0b01e2-3416-4972-bd61-15f7ad5ff11e tempest-GroupSnapshotsTest-769551106 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:26:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3e0b01e2-3416-4972-bd61-15f7ad5ff11e tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:26:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3e0b01e2-3416-4972-bd61-15f7ad5ff11e tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3e0b01e2-3416-4972-bd61-15f7ad5ff11e tempest-GroupSnapshotsTest-769551106 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.130s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:43 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-3e0b01e2-3416-4972-bd61-15f7ad5ff11e tempest-GroupSnapshotsTest-769551106 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:26:43 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-3e0b01e2-3416-4972-bd61-15f7ad5ff11e tempest-GroupSnapshotsTest-769551106 None] Delete group completed successfully.
Sep 22 23:26:46 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-4acead93-07b6-4884-a736-c1ccea9c33af tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:26:46 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-4acead93-07b6-4884-a736-c1ccea9c33af tempest-GroupSnapshotsTest-769551106 None] Group tempest-GroupSnapshotsTest-Group-1561748517: creating
Sep 22 23:26:46 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-4acead93-07b6-4884-a736-c1ccea9c33af tempest-GroupSnapshotsTest-769551106 None] Group tempest-GroupSnapshotsTest-Group-1561748517: created successfully
Sep 22 23:26:46 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-4acead93-07b6-4884-a736-c1ccea9c33af tempest-GroupSnapshotsTest-769551106 None] Create group completed successfully.
Sep 22 23:26:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:26:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:26:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:26:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:26:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:26:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:26:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.204s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:26:48 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:26:48 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:26:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Flow 'volume_create_manager' (854f4cf9-da63-489f-a480-2e0da96f388b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:26:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64dfebd4-ef58-4aa1-ade2-b0a421a7a64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64dfebd4-ef58-4aa1-ade2-b0a421a7a64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-276625227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ac68b2be-15cf-44c1-8b55-8436d1bf4a77,host='devstack@QuobyteHD#QuobyteHD',id=e3e69e12-0b28-4b3d-a786-4fdda187921e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a13239a679466ca7d8470c0e3f8f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:26:48Z,use_quota=True,user_id='cb6daa2f88c448cab1e52efd52fa2aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c293216c-9a5a-4e03-afa2-45c1caae696c),volume_type_id=c293216c-9a5a-4e03-afa2-45c1caae696c)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b8e4e94-ae48-4a49-b8a2-065fb4ba6816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b8e4e94-ae48-4a49-b8a2-065fb4ba6816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07354cff-205e-4cbd-8738-1dd095130337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07354cff-205e-4cbd-8738-1dd095130337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3e69e12-0b28-4b3d-a786-4fdda187921e', 'volume_name': 'volume-e3e69e12-0b28-4b3d-a786-4fdda187921e', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57c490a-55ba-4255-8dc0-978abba3b844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57c490a-55ba-4255-8dc0-978abba3b844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea1f42c6-53af-4a86-8624-8efa4d37c4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:48 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Volume e3e69e12-0b28-4b3d-a786-4fdda187921e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3e69e12-0b28-4b3d-a786-4fdda187921e', 'volume_size': 1}
Sep 22 23:26:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:26:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:26:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ac68b2be-15cf-44c1-8b55-8436d1bf4a77,created_at=2025-09-22T21:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-276625227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ac68b2be-15cf-44c1-8b55-8436d1bf4a77,host='devstack@QuobyteHD#QuobyteHD',id=e3e69e12-0b28-4b3d-a786-4fdda187921e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a13239a679466ca7d8470c0e3f8f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:26:48Z,use_quota=True,user_id='cb6daa2f88c448cab1e52efd52fa2aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c293216c-9a5a-4e03-afa2-45c1caae696c),volume_type_id=c293216c-9a5a-4e03-afa2-45c1caae696c)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:26:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Creating volume e3e69e12-0b28-4b3d-a786-4fdda187921e {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:26:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:26:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:26:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:26:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:26:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:26:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:26:49 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:26:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:49 devstack quobyte-client[84065]: System call of process 94286 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:49 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=56, name=volume-e3e69e12-0b28-4b3d-a786-4fdda187921e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:26:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e 1073741824" returned: 0 in 0.548s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e" returned: 0 in 0.190s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] <== create_volume: return (858ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:26:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:26:50 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea1f42c6-53af-4a86-8624-8efa4d37c4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3e69e12-0b28-4b3d-a786-4fdda187921e', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:50 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8609976f-dded-4976-bbc2-4406363fda55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:50 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Volume volume-e3e69e12-0b28-4b3d-a786-4fdda187921e (e3e69e12-0b28-4b3d-a786-4fdda187921e): created successfully
Sep 22 23:26:50 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8609976f-dded-4976-bbc2-4406363fda55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:50 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Flow 'volume_create_manager' (854f4cf9-da63-489f-a480-2e0da96f388b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:26:50 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-f54c438b-d09b-4542-860d-68ca4579c414 tempest-GroupSnapshotsTest-769551106 None] Created volume successfully.
Sep 22 23:26:51 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Flow 'volume_create_manager' (e5e1c20a-be59-49e4-a7ba-ba433bba363e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89286cf3-1dee-48cf-8a31-bbc06bfbba58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89286cf3-1dee-48cf-8a31-bbc06bfbba58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1256154958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ac68b2be-15cf-44c1-8b55-8436d1bf4a77,host='devstack@QuobyteHD#QuobyteHD',id=ec348203-c5f7-48cb-bed8-cf5bf660725f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a13239a679466ca7d8470c0e3f8f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:26:51Z,use_quota=True,user_id='cb6daa2f88c448cab1e52efd52fa2aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c293216c-9a5a-4e03-afa2-45c1caae696c),volume_type_id=c293216c-9a5a-4e03-afa2-45c1caae696c)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab162aa2-4d96-4282-be03-024d6b255713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab162aa2-4d96-4282-be03-024d6b255713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa03cab-0f00-4741-aeed-08c0142ed585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa03cab-0f00-4741-aeed-08c0142ed585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec348203-c5f7-48cb-bed8-cf5bf660725f', 'volume_name': 'volume-ec348203-c5f7-48cb-bed8-cf5bf660725f', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4aa0167-2f04-48b0-8bf0-c9251ae907f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4aa0167-2f04-48b0-8bf0-c9251ae907f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409b3467-bbf1-431d-a2f7-e39eac9fa9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:51 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Volume ec348203-c5f7-48cb-bed8-cf5bf660725f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec348203-c5f7-48cb-bed8-cf5bf660725f', 'volume_size': 1}
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ac68b2be-15cf-44c1-8b55-8436d1bf4a77,created_at=2025-09-22T21:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1256154958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ac68b2be-15cf-44c1-8b55-8436d1bf4a77,host='devstack@QuobyteHD#QuobyteHD',id=ec348203-c5f7-48cb-bed8-cf5bf660725f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a13239a679466ca7d8470c0e3f8f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:26:51Z,use_quota=True,user_id='cb6daa2f88c448cab1e52efd52fa2aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c293216c-9a5a-4e03-afa2-45c1caae696c),volume_type_id=c293216c-9a5a-4e03-afa2-45c1caae696c)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Creating volume ec348203-c5f7-48cb-bed8-cf5bf660725f {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:26:51 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:26:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:51 devstack quobyte-client[84065]: System call of process 94291 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:51 devstack quobyte-client[84065]: System call of process 94291 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:51 devstack quobyte-client[84065]: System call of process 94291 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:51 devstack quobyte-client[84065]: System call of process 94291 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:51 devstack quobyte-client[84065]: System call of process 94291 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:26:51 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=57, name=volume-ec348203-c5f7-48cb-bed8-cf5bf660725f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:26:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f 1073741824" returned: 0 in 0.565s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:26:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f" returned: 0 in 0.103s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:26:52 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] <== create_volume: return (787ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:26:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:26:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409b3467-bbf1-431d-a2f7-e39eac9fa9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec348203-c5f7-48cb-bed8-cf5bf660725f', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3aad364-597d-4e64-bd00-54bc9285a869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:26:52 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Volume volume-ec348203-c5f7-48cb-bed8-cf5bf660725f (ec348203-c5f7-48cb-bed8-cf5bf660725f): created successfully
Sep 22 23:26:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3aad364-597d-4e64-bd00-54bc9285a869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:26:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Flow 'volume_create_manager' (e5e1c20a-be59-49e4-a7ba-ba433bba363e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:26:52 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-a3784deb-1022-43ea-ac30-389db4638462 tempest-GroupSnapshotsTest-769551106 None] Created volume successfully.
Sep 22 23:26:53 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-c0b28e44-0c12-4c7f-a659-ba37a4dd0afd tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:26:54 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-c0b28e44-0c12-4c7f-a659-ba37a4dd0afd tempest-GroupSnapshotsTest-769551106 None] Update group completed successfully.
Sep 22 23:26:54 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-5e065fe0-bc5b-4b03-a4ad-c807b158ca39 tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:26:55 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-5e065fe0-bc5b-4b03-a4ad-c807b158ca39 tempest-GroupSnapshotsTest-769551106 None] Update group completed successfully.
Sep 22 23:26:56 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=62,cinder:UPDATE=52,cinder:DELETE=3,cinder:INSERT=15 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:26:56 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=56,cinder:UPDATE=52,cinder:DELETE=2,cinder:INSERT=3 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:26:56 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-5382b7b6-b0dc-40e2-80ca-46f4af80bed4 tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:26:56 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-5382b7b6-b0dc-40e2-80ca-46f4af80bed4 tempest-GroupSnapshotsTest-769551106 None] Update group completed successfully.
Sep 22 23:26:57 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-2b43074f-5efc-4aa3-baea-95b608d678a6 tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:26:57 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-2b43074f-5efc-4aa3-baea-95b608d678a6 tempest-GroupSnapshotsTest-769551106 None] Update group completed successfully.
Sep 22 23:26:59 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] GroupSnapshot fa96f102-2270-4efb-a48f-22b887e205b1: creating.
Sep 22 23:26:59 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:26:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Group snapshot fa96f102-2270-4efb-a48f-22b887e205b1: creating. {{(pid=84012) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 22 23:26:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:26:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:26:59 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Creating offline snapshot e7992d78-c2f1-41a1-8c3c-6951b58e357f of volume e3e69e12-0b28-4b3d-a786-4fdda187921e {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:26:59 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d89162-65a3-4fa3-9eed-710a86846e26]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:26:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:00 devstack quobyte-client[84065]: System call of process 94723 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e" returned: 0 in 0.605s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.e7992d78-c2f1-41a1-8c3c-6951b58e357f 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:00 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=58, name=volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.e7992d78-c2f1-41a1-8c3c-6951b58e357f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:27:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.e7992d78-c2f1-41a1-8c3c-6951b58e357f 1G" returned: 0 in 0.515s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e3e69e12-0b28-4b3d-a786-4fdda187921e -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.e7992d78-c2f1-41a1-8c3c-6951b58e357f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:01 devstack quobyte-client[84065]: System call of process 94735 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] CMD "qemu-img rebase -u -b volume-e3e69e12-0b28-4b3d-a786-4fdda187921e -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.e7992d78-c2f1-41a1-8c3c-6951b58e357f" returned: 0 in 0.250s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.e7992d78-c2f1-41a1-8c3c-6951b58e357f is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:27:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.e7992d78-c2f1-41a1-8c3c-6951b58e357f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.e7992d78-c2f1-41a1-8c3c-6951b58e357f" returned: 0 in 0.158s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:27:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.e7992d78-c2f1-41a1-8c3c-6951b58e357f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.e7992d78-c2f1-41a1-8c3c-6951b58e357f" returned: 0 in 0.187s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.info" returned: 0 in 0.177s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:02 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.info is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:27:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.info" returned: 0 in 0.136s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.606s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:27:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:27:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:27:02 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Creating offline snapshot ec9deb97-fd65-441c-aba5-34d7149690f0 of volume ec348203-c5f7-48cb-bed8-cf5bf660725f {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:27:02 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd40cc95-9715-49e9-acd0-de27280cb1a8]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:27:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:03 devstack quobyte-client[84065]: System call of process 94750 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:03 devstack quobyte-client[84065]: System call of process 94750 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:03 devstack quobyte-client[84065]: System call of process 94750 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f" returned: 0 in 1.532s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.ec9deb97-fd65-441c-aba5-34d7149690f0 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:04 devstack quobyte-client[84065]: System call of process 94799 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:05 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=60, name=volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.ec9deb97-fd65-441c-aba5-34d7149690f0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:27:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.ec9deb97-fd65-441c-aba5-34d7149690f0 1G" returned: 0 in 0.841s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ec348203-c5f7-48cb-bed8-cf5bf660725f -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.ec9deb97-fd65-441c-aba5-34d7149690f0 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:05 devstack quobyte-client[84065]: System call of process 94805 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] CMD "qemu-img rebase -u -b volume-ec348203-c5f7-48cb-bed8-cf5bf660725f -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.ec9deb97-fd65-441c-aba5-34d7149690f0" returned: 0 in 0.422s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.ec9deb97-fd65-441c-aba5-34d7149690f0 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:27:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.ec9deb97-fd65-441c-aba5-34d7149690f0 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.ec9deb97-fd65-441c-aba5-34d7149690f0" returned: 0 in 0.261s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:06 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:27:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.ec9deb97-fd65-441c-aba5-34d7149690f0 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.ec9deb97-fd65-441c-aba5-34d7149690f0" returned: 0 in 0.225s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.info" returned: 0 in 0.304s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:07 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.info is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:27:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.info" returned: 0 in 0.247s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.226s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:27:08 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-329566dd-6b03-4823-871c-d1adb2573d6f tempest-GroupSnapshotsTest-769551106 None] group_snapshot fa96f102-2270-4efb-a48f-22b887e205b1: created successfully
Sep 22 23:27:09 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] group_snapshot fa96f102-2270-4efb-a48f-22b887e205b1: deleting
Sep 22 23:27:09 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:27:09 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] group_snapshot fa96f102-2270-4efb-a48f-22b887e205b1: deleting {{(pid=84012) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 22 23:27:10 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "cinder-quobyte-e3e69e12-0b28-4b3d-a786-4fdda187921e" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:27:10 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-e3e69e12-0b28-4b3d-a786-4fdda187921e" acquired by "delete_snapshot" :: waited 0.078s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:27:10 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "cinder-quobyte-e7992d78-c2f1-41a1-8c3c-6951b58e357f" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:27:10 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-e7992d78-c2f1-41a1-8c3c-6951b58e357f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:27:10 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Deleting offline snapshot e7992d78-c2f1-41a1-8c3c-6951b58e357f of volume e3e69e12-0b28-4b3d-a786-4fdda187921e {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:27:10 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] snapshot_file for this snap is: volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.e7992d78-c2f1-41a1-8c3c-6951b58e357f {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:27:10 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e402c3a5-7bac-43f7-9f95-84649a8fdd4e]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:27:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.e7992d78-c2f1-41a1-8c3c-6951b58e357f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.e7992d78-c2f1-41a1-8c3c-6951b58e357f" returned: 0 in 0.813s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:11 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3e69e12-0b28-4b3d-a786-4fdda187921e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:27:11 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[42584d02-c5cf-4cc6-b828-3f0cf60f845e]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:27:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e" returned: 0 in 0.842s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.e7992d78-c2f1-41a1-8c3c-6951b58e357f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:12 devstack quobyte-client[84065]: System call of process 94833 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:12 devstack quobyte-client[84065]: System call of process 94833 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.e7992d78-c2f1-41a1-8c3c-6951b58e357f" returned: 0 in 0.461s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.e7992d78-c2f1-41a1-8c3c-6951b58e357f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e.e7992d78-c2f1-41a1-8c3c-6951b58e357f" returned: 0 in 0.137s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-e7992d78-c2f1-41a1-8c3c-6951b58e357f" released by "_delete_snapshot" :: held 2.859s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:27:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-e3e69e12-0b28-4b3d-a786-4fdda187921e" released by "delete_snapshot" :: held 2.903s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:27:13 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "cinder-quobyte-ec348203-c5f7-48cb-bed8-cf5bf660725f" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:27:13 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-ec348203-c5f7-48cb-bed8-cf5bf660725f" acquired by "delete_snapshot" :: waited 0.034s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:27:13 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "cinder-quobyte-ec9deb97-fd65-441c-aba5-34d7149690f0" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:27:13 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-ec9deb97-fd65-441c-aba5-34d7149690f0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:27:13 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Deleting offline snapshot ec9deb97-fd65-441c-aba5-34d7149690f0 of volume ec348203-c5f7-48cb-bed8-cf5bf660725f {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:27:13 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] snapshot_file for this snap is: volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.ec9deb97-fd65-441c-aba5-34d7149690f0 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:27:13 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dea567-eee1-47ae-b221-2b66c42bcaaa]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:27:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.ec9deb97-fd65-441c-aba5-34d7149690f0 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:14 devstack quobyte-client[84065]: System call of process 94837 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.ec9deb97-fd65-441c-aba5-34d7149690f0" returned: 0 in 0.908s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec348203-c5f7-48cb-bed8-cf5bf660725f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:27:14 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[466c3c16-3e5f-4d01-9fdd-160cdd335721]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:27:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f" returned: 0 in 0.484s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.ec9deb97-fd65-441c-aba5-34d7149690f0 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:15 devstack quobyte-client[84065]: System call of process 94868 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.ec9deb97-fd65-441c-aba5-34d7149690f0" returned: 0 in 0.256s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.ec9deb97-fd65-441c-aba5-34d7149690f0 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f.ec9deb97-fd65-441c-aba5-34d7149690f0" returned: 0 in 0.132s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:15 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-ec9deb97-fd65-441c-aba5-34d7149690f0" released by "_delete_snapshot" :: held 2.422s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:27:15 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-ec348203-c5f7-48cb-bed8-cf5bf660725f" released by "delete_snapshot" :: held 2.467s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:27:16 devstack cinder-volume[84012]: WARNING cinder.quota [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1792189220 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1792189220, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:27:16 devstack cinder-volume[84012]: WARNING cinder.quota [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1792189220 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1792189220, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:27:16 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Created reservations ['ee9541d5-14b2-4eda-abeb-b0d94afe9de1', '0d412cb5-8b42-4ebe-b788-6f5f040a4120', 'aea2a03e-22b9-4684-ab4d-4c1c3d89628d', 'c763e8b1-53db-459a-902c-35db3a37642b'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:27:16 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] Created reservations ['60a5d760-12a7-4cb8-a9c6-f2ea608872f7', 'c54a9594-fb45-46b1-bed3-0739851a4158', '56deb42e-aeb4-4df5-9915-85b379861902', '95deebea-0706-4c3e-bca5-fd6776e7cb37'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:27:17 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-938cf140-5437-416a-be0b-80cadf4917ae tempest-GroupSnapshotsTest-769551106 None] group_snapshot fa96f102-2270-4efb-a48f-22b887e205b1: deleted successfully
Sep 22 23:27:18 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:27:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "cinder-quobyte-e3e69e12-0b28-4b3d-a786-4fdda187921e" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:27:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-e3e69e12-0b28-4b3d-a786-4fdda187921e" acquired by "delete_volume" :: waited 0.046s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:27:18 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6dca70-0ed0-47fd-a3c6-80a0157d9019]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:27:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:19 devstack quobyte-client[84065]: System call of process 94873 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e" returned: 0 in 0.712s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3e69e12-0b28-4b3d-a786-4fdda187921e" returned: 0 in 0.298s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-e3e69e12-0b28-4b3d-a786-4fdda187921e" released by "delete_volume" :: held 1.341s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:27:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "cinder-quobyte-ec348203-c5f7-48cb-bed8-cf5bf660725f" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:27:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-ec348203-c5f7-48cb-bed8-cf5bf660725f" acquired by "delete_volume" :: waited 0.030s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:27:20 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e53e5a1-9770-4b37-acaa-50b5637d24eb]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:27:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f" returned: 0 in 0.617s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ec348203-c5f7-48cb-bed8-cf5bf660725f" returned: 0 in 0.140s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:21 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-ec348203-c5f7-48cb-bed8-cf5bf660725f" released by "delete_volume" :: held 1.223s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:27:21 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Created reservations ['2b899e7a-a2a9-415b-a009-e3b5df86a803'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:27:21 devstack cinder-volume[84012]: WARNING cinder.quota [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1792189220 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1792189220, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:27:21 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Created reservations ['97e05b55-4a42-4981-9dea-532a63178619', 'f952b857-c60f-46aa-aa6b-d428804ca851', 'bd4fd1e1-42ab-4305-99d7-f2d3106491bf', '85cdf5a6-0dd2-4127-861f-c2ad5962d93e'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:27:22 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Created reservations ['66599c6c-a143-4f10-8c3d-b4bdd1aeb417', '46102aae-11f0-4ce3-a2f7-313dac0928c2', 'aec9b3de-2458-417b-afee-6d7f30985a6c', 'e824622e-cd14-4e91-a372-4370c301fee4'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:27:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:27:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:27:22 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:27:22 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:27:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:27:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.135s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:22 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:27:22 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-3a1c48c0-21fd-405e-9d1f-9da85dce5077 tempest-GroupSnapshotsTest-769551106 None] Delete group completed successfully.
Sep 22 23:27:24 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-efddbc4a-9b6c-48e1-a7d1-149727281998 tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:27:24 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-efddbc4a-9b6c-48e1-a7d1-149727281998 tempest-GroupSnapshotsTest-769551106 None] Group tempest-GroupSnapshotsTest-Group-2079254400: creating
Sep 22 23:27:25 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-efddbc4a-9b6c-48e1-a7d1-149727281998 tempest-GroupSnapshotsTest-769551106 None] Group tempest-GroupSnapshotsTest-Group-2079254400: created successfully
Sep 22 23:27:25 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-efddbc4a-9b6c-48e1-a7d1-149727281998 tempest-GroupSnapshotsTest-769551106 None] Create group completed successfully.
Sep 22 23:27:27 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Flow 'volume_create_manager' (8de27199-97aa-41de-90d8-65d6cdb9e8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b2159f-cd22-4282-87da-c5db398f5d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b2159f-cd22-4282-87da-c5db398f5d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-245488918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=58988e00-0ecb-47af-9087-23c6a07b130e,host='devstack@QuobyteHD#QuobyteHD',id=817c503f-324f-48ba-8839-b3e7cebba2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a13239a679466ca7d8470c0e3f8f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:27:27Z,use_quota=True,user_id='cb6daa2f88c448cab1e52efd52fa2aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3da964f8-62ee-4476-adbb-29c76c6f50c8),volume_type_id=3da964f8-62ee-4476-adbb-29c76c6f50c8)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ca959e-ddb1-4a20-8441-84b8f8765246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ca959e-ddb1-4a20-8441-84b8f8765246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5266b87-bb2b-433e-8d79-d939df213732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5266b87-bb2b-433e-8d79-d939df213732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '817c503f-324f-48ba-8839-b3e7cebba2f1', 'volume_name': 'volume-817c503f-324f-48ba-8839-b3e7cebba2f1', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b8f450-cf97-471f-a576-de89bbbbd0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b8f450-cf97-471f-a576-de89bbbbd0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3142e56-83a0-480c-b2af-20f34b1b405d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:27:27 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Volume 817c503f-324f-48ba-8839-b3e7cebba2f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-817c503f-324f-48ba-8839-b3e7cebba2f1', 'volume_size': 1}
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=58988e00-0ecb-47af-9087-23c6a07b130e,created_at=2025-09-22T21:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-245488918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=58988e00-0ecb-47af-9087-23c6a07b130e,host='devstack@QuobyteHD#QuobyteHD',id=817c503f-324f-48ba-8839-b3e7cebba2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a13239a679466ca7d8470c0e3f8f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:27:27Z,use_quota=True,user_id='cb6daa2f88c448cab1e52efd52fa2aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3da964f8-62ee-4476-adbb-29c76c6f50c8),volume_type_id=3da964f8-62ee-4476-adbb-29c76c6f50c8)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Creating volume 817c503f-324f-48ba-8839-b3e7cebba2f1 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:27:27 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:27:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:27 devstack quobyte-client[84065]: System call of process 94886 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:27 devstack quobyte-client[84065]: System call of process 94886 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:27 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=62, name=volume-817c503f-324f-48ba-8839-b3e7cebba2f1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:27:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1 1073741824" returned: 0 in 0.553s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1" returned: 0 in 0.394s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] <== create_volume: return (1305ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:27:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:27:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3142e56-83a0-480c-b2af-20f34b1b405d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-817c503f-324f-48ba-8839-b3e7cebba2f1', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:27:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05feed9-7985-46d6-a6a8-543a66220b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:27:30 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Volume volume-817c503f-324f-48ba-8839-b3e7cebba2f1 (817c503f-324f-48ba-8839-b3e7cebba2f1): created successfully
Sep 22 23:27:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05feed9-7985-46d6-a6a8-543a66220b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:27:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Flow 'volume_create_manager' (8de27199-97aa-41de-90d8-65d6cdb9e8b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:27:30 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-c441193d-d781-48a6-a539-51a129c2ba77 tempest-GroupSnapshotsTest-769551106 None] Created volume successfully.
Sep 22 23:27:32 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] GroupSnapshot ffe8b20d-3247-4ed9-b66c-7ff28f79440e: creating.
Sep 22 23:27:32 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:27:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] Group snapshot ffe8b20d-3247-4ed9-b66c-7ff28f79440e: creating. {{(pid=84012) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 22 23:27:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:27:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.013s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:27:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] Creating offline snapshot 8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5 of volume 817c503f-324f-48ba-8839-b3e7cebba2f1 {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:27:33 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb78db1-288a-4c09-84e4-ead43eb06e3e]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:27:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:34 devstack quobyte-client[84065]: System call of process 94929 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1" returned: 0 in 1.129s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1.8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:34 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=63, name=volume-817c503f-324f-48ba-8839-b3e7cebba2f1.8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:27:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1.8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5 1G" returned: 0 in 0.501s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): qemu-img rebase -u -b volume-817c503f-324f-48ba-8839-b3e7cebba2f1 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1.8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] CMD "qemu-img rebase -u -b volume-817c503f-324f-48ba-8839-b3e7cebba2f1 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1.8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5" returned: 0 in 0.358s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1.8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:27:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1.8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1.8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5" returned: 0 in 0.258s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1 -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:27:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1.8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1.8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5" returned: 0 in 0.211s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1.info" returned: 0 in 0.229s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1.info is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:27:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1.info" returned: 0 in 0.392s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.010s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:27:37 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-af11275f-61e2-45a4-84c6-111bf993a93e tempest-GroupSnapshotsTest-769551106 None] group_snapshot ffe8b20d-3247-4ed9-b66c-7ff28f79440e: created successfully
Sep 22 23:27:39 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] group_snapshot ffe8b20d-3247-4ed9-b66c-7ff28f79440e: deleting
Sep 22 23:27:39 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:27:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] group_snapshot ffe8b20d-3247-4ed9-b66c-7ff28f79440e: deleting {{(pid=84012) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 22 23:27:39 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "cinder-quobyte-817c503f-324f-48ba-8839-b3e7cebba2f1" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:27:39 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-817c503f-324f-48ba-8839-b3e7cebba2f1" acquired by "delete_snapshot" :: waited 0.057s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:27:39 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "cinder-quobyte-8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:27:39 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:27:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] Deleting offline snapshot 8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5 of volume 817c503f-324f-48ba-8839-b3e7cebba2f1 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:27:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] snapshot_file for this snap is: volume-817c503f-324f-48ba-8839-b3e7cebba2f1.8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:27:39 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b619a219-080a-4382-b4ce-f7e71c0b03c8]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:27:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1.8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:40 devstack quobyte-client[84065]: System call of process 94952 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:40 devstack quobyte-client[84065]: System call of process 94952 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:40 devstack quobyte-client[84065]: System call of process 94952 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1.8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5" returned: 0 in 0.811s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-817c503f-324f-48ba-8839-b3e7cebba2f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:27:40 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5385a3-2948-4421-9604-b456e2514d05]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:27:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:41 devstack quobyte-client[84065]: System call of process 94955 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1" returned: 0 in 1.117s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1.8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:41 devstack quobyte-client[84065]: System call of process 94958 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1.8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5" returned: 0 in 0.404s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1.8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1.8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5" returned: 0 in 0.150s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:42 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-8eb9c19e-8ff7-4525-a744-7d13fb2bbcc5" released by "_delete_snapshot" :: held 3.149s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:27:42 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-817c503f-324f-48ba-8839-b3e7cebba2f1" released by "delete_snapshot" :: held 3.181s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:27:42 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:27:42 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:27:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Flow 'volume_create_manager' (fc51f828-10d5-4eca-8ea5-843cc07db160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62b5c4e-260c-469c-9569-ba7889cc0ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62b5c4e-260c-469c-9569-ba7889cc0ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-730565760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a0cec80-e47e-4073-8c2a-1d181543d248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71bd6aafa88b43cc91c1de95e4fc6a5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:27:43Z,use_quota=True,user_id='548170846dd54cfe8b1e00f92b84b1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d42a38-2d21-4da7-b5dc-a0a5edcc3f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d42a38-2d21-4da7-b5dc-a0a5edcc3f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333bff5c-20b3-4d5a-9939-19def6240bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333bff5c-20b3-4d5a-9939-19def6240bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a0cec80-e47e-4073-8c2a-1d181543d248', 'volume_name': 'volume-7a0cec80-e47e-4073-8c2a-1d181543d248', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81298874-7d59-4879-afc4-46f902e9f90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81298874-7d59-4879-afc4-46f902e9f90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569aca6a-03b5-4e8f-a1fc-6cf4e75168ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:27:43 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Volume 7a0cec80-e47e-4073-8c2a-1d181543d248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a0cec80-e47e-4073-8c2a-1d181543d248', 'volume_size': 1}
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-730565760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a0cec80-e47e-4073-8c2a-1d181543d248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71bd6aafa88b43cc91c1de95e4fc6a5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:27:43Z,use_quota=True,user_id='548170846dd54cfe8b1e00f92b84b1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Creating volume 7a0cec80-e47e-4073-8c2a-1d181543d248 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:27:43 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7a0cec80-e47e-4073-8c2a-1d181543d248 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:43 devstack quobyte-client[84065]: System call of process 94962 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:43 devstack quobyte-client[84065]: System call of process 94962 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:43 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=65, name=volume-7a0cec80-e47e-4073-8c2a-1d181543d248, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7a0cec80-e47e-4073-8c2a-1d181543d248 1073741824" returned: 0 in 0.779s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7a0cec80-e47e-4073-8c2a-1d181543d248 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:44 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Flow 'volume_create_manager' (3cdf0052-52b7-47b8-a8dd-b37c0bdda740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8de668e-7191-4e56-9904-6d4b489ffb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:27:44 devstack cinder-volume[84012]: WARNING cinder.quota [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-579425412 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-579425412, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:27:44 devstack cinder-volume[84012]: WARNING cinder.quota [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-579425412 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-579425412, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8de668e-7191-4e56-9904-6d4b489ffb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-477008031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0261afdc-8ca5-4672-8184-4673dc9b10f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71bd6aafa88b43cc91c1de95e4fc6a5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:27:43Z,use_quota=True,user_id='548170846dd54cfe8b1e00f92b84b1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a41a91-567c-43f1-ad93-c73fe1e49ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a41a91-567c-43f1-ad93-c73fe1e49ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229ef112-f3c2-485f-9b9b-87f77aa68fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229ef112-f3c2-485f-9b9b-87f77aa68fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0261afdc-8ca5-4672-8184-4673dc9b10f9', 'volume_name': 'volume-0261afdc-8ca5-4672-8184-4673dc9b10f9', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd65bf3-f367-43df-9f6a-29f5604a6465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd65bf3-f367-43df-9f6a-29f5604a6465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd63b06-91be-4fde-9615-8f603fd8c55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:27:44 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Volume 0261afdc-8ca5-4672-8184-4673dc9b10f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0261afdc-8ca5-4672-8184-4673dc9b10f9', 'volume_size': 1}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7a0cec80-e47e-4073-8c2a-1d181543d248" returned: 0 in 0.839s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] <== create_volume: return (1707ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.050s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-477008031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0261afdc-8ca5-4672-8184-4673dc9b10f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71bd6aafa88b43cc91c1de95e4fc6a5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:27:43Z,use_quota=True,user_id='548170846dd54cfe8b1e00f92b84b1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Creating volume 0261afdc-8ca5-4672-8184-4673dc9b10f9 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:27:44 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:27:44 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:27:45 devstack quobyte-client[84065]: System call of process 94967 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0261afdc-8ca5-4672-8184-4673dc9b10f9 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:45 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=66, name=volume-0261afdc-8ca5-4672-8184-4673dc9b10f9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:27:45 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569aca6a-03b5-4e8f-a1fc-6cf4e75168ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a0cec80-e47e-4073-8c2a-1d181543d248', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:27:45 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e43003-5dff-48a1-b5fa-d2fcb838850c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:27:45 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] Created reservations ['5114aa47-a031-4708-b436-415e4ad8d1db', '2191f485-8c6e-4ea0-ac88-3f7994d0db59', '20bba2b7-d4d0-43e4-a928-5213ff22cf1c', '0f51c6bc-e78a-44c1-b97c-c31acf8aade1'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:27:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0261afdc-8ca5-4672-8184-4673dc9b10f9 1073741824" returned: 0 in 0.712s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0261afdc-8ca5-4672-8184-4673dc9b10f9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:46 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Volume volume-7a0cec80-e47e-4073-8c2a-1d181543d248 (7a0cec80-e47e-4073-8c2a-1d181543d248): created successfully
Sep 22 23:27:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e43003-5dff-48a1-b5fa-d2fcb838850c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:27:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Flow 'volume_create_manager' (fc51f828-10d5-4eca-8ea5-843cc07db160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:27:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0261afdc-8ca5-4672-8184-4673dc9b10f9" returned: 0 in 0.575s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] <== create_volume: return (1324ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:27:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:27:46 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-805fa710-1afe-4fdc-98d5-52babb6b9c3d tempest-TestServerVolumeAttachmentScenario-380903181 None] Created volume successfully.
Sep 22 23:27:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd63b06-91be-4fde-9615-8f603fd8c55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0261afdc-8ca5-4672-8184-4673dc9b10f9', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:27:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f0ac40-fe69-47ff-a79c-1a31c079ac54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:27:46 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Volume volume-0261afdc-8ca5-4672-8184-4673dc9b10f9 (0261afdc-8ca5-4672-8184-4673dc9b10f9): created successfully
Sep 22 23:27:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f0ac40-fe69-47ff-a79c-1a31c079ac54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:27:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Flow 'volume_create_manager' (3cdf0052-52b7-47b8-a8dd-b37c0bdda740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:27:46 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-74fffdf6-ebd7-402d-aeca-fdcc69a675f1 tempest-GroupSnapshotsTest-769551106 None] group_snapshot ffe8b20d-3247-4ed9-b66c-7ff28f79440e: deleted successfully
Sep 22 23:27:46 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-655a55c5-1671-4ff7-a3ee-b6731c1ab2e6 tempest-TestServerVolumeAttachmentScenario-380903181 None] Created volume successfully.
Sep 22 23:27:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:27:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:27:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:27:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:27:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:27:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:27:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:48 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-51fb66d0-625f-4280-8f4e-b604952b7291 tempest-GroupSnapshotsTest-769551106 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:27:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.857s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:48 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-51fb66d0-625f-4280-8f4e-b604952b7291 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "cinder-quobyte-817c503f-324f-48ba-8839-b3e7cebba2f1" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:27:49 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:27:49 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-51fb66d0-625f-4280-8f4e-b604952b7291 tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-817c503f-324f-48ba-8839-b3e7cebba2f1" acquired by "delete_volume" :: waited 0.273s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:27:49 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fd6f31-cd13-4d81-bba6-bdddebe5f29b]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:27:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-51fb66d0-625f-4280-8f4e-b604952b7291 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:49 devstack quobyte-client[84065]: System call of process 94976 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:49 devstack quobyte-client[84065]: System call of process 94976 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:49 devstack quobyte-client[84065]: System call of process 94976 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:27:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-51fb66d0-625f-4280-8f4e-b604952b7291 tempest-GroupSnapshotsTest-769551106 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1" returned: 0 in 0.504s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-51fb66d0-625f-4280-8f4e-b604952b7291 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-51fb66d0-625f-4280-8f4e-b604952b7291 tempest-GroupSnapshotsTest-769551106 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-817c503f-324f-48ba-8839-b3e7cebba2f1" returned: 0 in 0.150s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-51fb66d0-625f-4280-8f4e-b604952b7291 tempest-GroupSnapshotsTest-769551106 None] Lock "cinder-quobyte-817c503f-324f-48ba-8839-b3e7cebba2f1" released by "delete_volume" :: held 0.947s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:27:50 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-51fb66d0-625f-4280-8f4e-b604952b7291 tempest-GroupSnapshotsTest-769551106 None] Created reservations ['00aeb07a-4dc8-4c00-974c-6ee6ebb44471'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:27:50 devstack cinder-volume[84012]: WARNING cinder.quota [None req-51fb66d0-625f-4280-8f4e-b604952b7291 tempest-GroupSnapshotsTest-769551106 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-579425412 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-579425412, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:27:50 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-51fb66d0-625f-4280-8f4e-b604952b7291 tempest-GroupSnapshotsTest-769551106 None] Created reservations ['4f03644e-4bf4-4ff2-8863-bd64c7e6f8ed', '6d33f28c-19ac-4dde-a6e3-71b5b35f4f9c', '3a4a97a4-bb33-40fc-8c8f-fff8ee39dc0b', '15a3dd29-36e3-4318-8e6b-1fa777339192'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:27:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-51fb66d0-625f-4280-8f4e-b604952b7291 tempest-GroupSnapshotsTest-769551106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:27:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-51fb66d0-625f-4280-8f4e-b604952b7291 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:27:50 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-51fb66d0-625f-4280-8f4e-b604952b7291 tempest-GroupSnapshotsTest-769551106 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:27:50 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-51fb66d0-625f-4280-8f4e-b604952b7291 tempest-GroupSnapshotsTest-769551106 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:27:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-51fb66d0-625f-4280-8f4e-b604952b7291 tempest-GroupSnapshotsTest-769551106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:27:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-51fb66d0-625f-4280-8f4e-b604952b7291 tempest-GroupSnapshotsTest-769551106 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:27:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-51fb66d0-625f-4280-8f4e-b604952b7291 tempest-GroupSnapshotsTest-769551106 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.089s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:27:51 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-51fb66d0-625f-4280-8f4e-b604952b7291 tempest-GroupSnapshotsTest-769551106 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:27:51 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-51fb66d0-625f-4280-8f4e-b604952b7291 tempest-GroupSnapshotsTest-769551106 None] Delete group completed successfully.
Sep 22 23:27:59 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=62,cinder:UPDATE=60,cinder:INSERT=6,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:27:59 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-54560845-8807-4840-93ea-09fe94373aff tempest-GroupSnapshotsV319Test-754976635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:27:59 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-54560845-8807-4840-93ea-09fe94373aff tempest-GroupSnapshotsV319Test-754976635 None] Group tempest-GroupSnapshotsV319Test-Group-1837751600: creating
Sep 22 23:27:59 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=61,cinder:UPDATE=62,cinder:INSERT=20,cinder:DELETE=2 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:27:59 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-54560845-8807-4840-93ea-09fe94373aff tempest-GroupSnapshotsV319Test-754976635 None] Group tempest-GroupSnapshotsV319Test-Group-1837751600: created successfully
Sep 22 23:28:00 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-54560845-8807-4840-93ea-09fe94373aff tempest-GroupSnapshotsV319Test-754976635 None] Create group completed successfully.
Sep 22 23:28:01 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Flow 'volume_create_manager' (4805cf8e-6f05-43f2-9e2f-f4a9bbc5e048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f749ee-e173-4c26-9b3b-7e6881c83e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f749ee-e173-4c26-9b3b-7e6881c83e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-755215705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=04b29f30-7382-442d-969f-655d40799326,host='devstack@QuobyteHD#QuobyteHD',id=55f6bea3-a346-47cf-b56d-bfd812e9846e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55346dfa61d43efa6bf7781953e63d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:28:01Z,use_quota=True,user_id='3b2fd67dd7e94281958a06cddf1f9d94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b030af44-cb7c-42bf-a33f-60b3492266fe),volume_type_id=b030af44-cb7c-42bf-a33f-60b3492266fe)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba7761c5-5c61-4b7a-bfa5-038401ebea9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba7761c5-5c61-4b7a-bfa5-038401ebea9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e4e193-9c5c-4223-81ab-29925f26b186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e4e193-9c5c-4223-81ab-29925f26b186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55f6bea3-a346-47cf-b56d-bfd812e9846e', 'volume_name': 'volume-55f6bea3-a346-47cf-b56d-bfd812e9846e', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0016a2f-4ca0-426f-a17f-adb75af07045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0016a2f-4ca0-426f-a17f-adb75af07045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a682a0b7-5637-489f-b6b2-9afdd965d1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:01 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Volume 55f6bea3-a346-47cf-b56d-bfd812e9846e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55f6bea3-a346-47cf-b56d-bfd812e9846e', 'volume_size': 1}
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=04b29f30-7382-442d-969f-655d40799326,created_at=2025-09-22T21:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-755215705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=04b29f30-7382-442d-969f-655d40799326,host='devstack@QuobyteHD#QuobyteHD',id=55f6bea3-a346-47cf-b56d-bfd812e9846e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55346dfa61d43efa6bf7781953e63d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:28:01Z,use_quota=True,user_id='3b2fd67dd7e94281958a06cddf1f9d94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b030af44-cb7c-42bf-a33f-60b3492266fe),volume_type_id=b030af44-cb7c-42bf-a33f-60b3492266fe)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Creating volume 55f6bea3-a346-47cf-b56d-bfd812e9846e {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:28:01 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:28:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:01 devstack quobyte-client[84065]: System call of process 95008 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:28:01 devstack quobyte-client[84065]: System call of process 95008 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:28:01 devstack quobyte-client[84065]: System call of process 95008 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:28:01 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=67, name=volume-55f6bea3-a346-47cf-b56d-bfd812e9846e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:28:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e 1073741824" returned: 0 in 0.605s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e" returned: 0 in 0.162s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:02 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] <== create_volume: return (858ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:28:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:28:02 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a682a0b7-5637-489f-b6b2-9afdd965d1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55f6bea3-a346-47cf-b56d-bfd812e9846e', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:02 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f0c8ab-b26b-494a-8e2d-a066d1f19c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:02 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Volume volume-55f6bea3-a346-47cf-b56d-bfd812e9846e (55f6bea3-a346-47cf-b56d-bfd812e9846e): created successfully
Sep 22 23:28:02 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f0c8ab-b26b-494a-8e2d-a066d1f19c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:02 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Flow 'volume_create_manager' (4805cf8e-6f05-43f2-9e2f-f4a9bbc5e048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:28:02 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-fd26a6fc-fcc7-48c9-a3ef-f68f9dd05fd3 tempest-GroupSnapshotsV319Test-754976635 None] Created volume successfully.
Sep 22 23:28:04 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] GroupSnapshot bd195f62-e51d-4230-b3f6-0cf6ae22c21a: creating.
Sep 22 23:28:04 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:28:04 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] Group snapshot bd195f62-e51d-4230-b3f6-0cf6ae22c21a: creating. {{(pid=84012) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 22 23:28:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:28:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:28:04 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] Creating offline snapshot e841dc3b-90b4-45c3-ae13-8068e95cd1d5 of volume 55f6bea3-a346-47cf-b56d-bfd812e9846e {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:28:04 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd30197-1a59-4621-a7ac-8170d7d22c61]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:28:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:04 devstack quobyte-client[84065]: System call of process 95020 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:28:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e" returned: 0 in 0.575s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.e841dc3b-90b4-45c3-ae13-8068e95cd1d5 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:05 devstack quobyte-client[84065]: System call of process 95026 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:28:05 devstack quobyte-client[84065]: System call of process 95026 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:28:05 devstack quobyte-client[84065]: System call of process 95026 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:28:05 devstack quobyte-client[84065]: System call of process 95026 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:28:05 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=68, name=volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.e841dc3b-90b4-45c3-ae13-8068e95cd1d5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:28:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.e841dc3b-90b4-45c3-ae13-8068e95cd1d5 1G" returned: 0 in 0.441s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] Running cmd (subprocess): qemu-img rebase -u -b volume-55f6bea3-a346-47cf-b56d-bfd812e9846e -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.e841dc3b-90b4-45c3-ae13-8068e95cd1d5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] CMD "qemu-img rebase -u -b volume-55f6bea3-a346-47cf-b56d-bfd812e9846e -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.e841dc3b-90b4-45c3-ae13-8068e95cd1d5" returned: 0 in 0.166s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.e841dc3b-90b4-45c3-ae13-8068e95cd1d5 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:28:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.e841dc3b-90b4-45c3-ae13-8068e95cd1d5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.e841dc3b-90b4-45c3-ae13-8068e95cd1d5" returned: 0 in 0.100s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:28:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.e841dc3b-90b4-45c3-ae13-8068e95cd1d5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.e841dc3b-90b4-45c3-ae13-8068e95cd1d5" returned: 0 in 0.115s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.info" returned: 0 in 0.111s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:06 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.info is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:28:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.info" returned: 0 in 0.106s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.095s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:28:06 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-cf851107-984b-4bf5-a0ae-684c328e856e tempest-GroupSnapshotsV319Test-754976635 None] group_snapshot bd195f62-e51d-4230-b3f6-0cf6ae22c21a: created successfully
Sep 22 23:28:08 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] group_snapshot bd195f62-e51d-4230-b3f6-0cf6ae22c21a: deleting
Sep 22 23:28:08 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:28:08 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] group_snapshot bd195f62-e51d-4230-b3f6-0cf6ae22c21a: deleting {{(pid=84012) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 22 23:28:08 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] Acquiring lock "cinder-quobyte-55f6bea3-a346-47cf-b56d-bfd812e9846e" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:28:08 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] Lock "cinder-quobyte-55f6bea3-a346-47cf-b56d-bfd812e9846e" acquired by "delete_snapshot" :: waited 0.179s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:28:08 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] Acquiring lock "cinder-quobyte-e841dc3b-90b4-45c3-ae13-8068e95cd1d5" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:28:08 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] Lock "cinder-quobyte-e841dc3b-90b4-45c3-ae13-8068e95cd1d5" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:28:08 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] Deleting offline snapshot e841dc3b-90b4-45c3-ae13-8068e95cd1d5 of volume 55f6bea3-a346-47cf-b56d-bfd812e9846e {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:28:08 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] snapshot_file for this snap is: volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.e841dc3b-90b4-45c3-ae13-8068e95cd1d5 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:28:08 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a395bf5-5a21-4dff-a69c-576cbc0bc128]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:28:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.e841dc3b-90b4-45c3-ae13-8068e95cd1d5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:09 devstack quobyte-client[84065]: System call of process 95052 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:28:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.e841dc3b-90b4-45c3-ae13-8068e95cd1d5" returned: 0 in 0.619s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:09 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55f6bea3-a346-47cf-b56d-bfd812e9846e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:28:09 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc480b47-5ce9-444b-be49-cee9da282cb9]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:28:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:11 devstack quobyte-client[84065]: System call of process 95060 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:28:11 devstack quobyte-client[84065]: System call of process 95060 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:28:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e" returned: 0 in 2.160s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.e841dc3b-90b4-45c3-ae13-8068e95cd1d5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:12 devstack quobyte-client[84065]: System call of process 95095 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:28:12 devstack quobyte-client[84065]: System call of process 95095 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:28:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.e841dc3b-90b4-45c3-ae13-8068e95cd1d5" returned: 0 in 0.981s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.e841dc3b-90b4-45c3-ae13-8068e95cd1d5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e.e841dc3b-90b4-45c3-ae13-8068e95cd1d5" returned: 0 in 0.804s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:14 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] Lock "cinder-quobyte-e841dc3b-90b4-45c3-ae13-8068e95cd1d5" released by "_delete_snapshot" :: held 5.475s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:28:14 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] Lock "cinder-quobyte-55f6bea3-a346-47cf-b56d-bfd812e9846e" released by "delete_snapshot" :: held 5.538s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:28:14 devstack cinder-volume[84012]: WARNING cinder.quota [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-623124832 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-623124832, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:28:14 devstack cinder-volume[84012]: WARNING cinder.quota [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-623124832 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-623124832, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:28:14 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] Created reservations ['7da316c2-7528-4a92-be55-dfc1d9cf38d1', 'f2e8ebb6-6771-4546-8a07-d03ba4f09529', '3c75392f-d152-4daa-8d89-8bdd2951a117', 'a9370301-d176-4b66-9f23-e63ca326e3cd'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:28:15 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-a7997759-aa22-4dbc-9d10-8955af54a4b3 tempest-GroupSnapshotsV319Test-754976635 None] group_snapshot bd195f62-e51d-4230-b3f6-0cf6ae22c21a: deleted successfully
Sep 22 23:28:16 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-90cc4c9d-681c-44ab-9b05-565aca1d824e tempest-GroupSnapshotsV319Test-754976635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:28:16 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-90cc4c9d-681c-44ab-9b05-565aca1d824e tempest-GroupSnapshotsV319Test-754976635 None] Acquiring lock "cinder-quobyte-55f6bea3-a346-47cf-b56d-bfd812e9846e" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:28:16 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-90cc4c9d-681c-44ab-9b05-565aca1d824e tempest-GroupSnapshotsV319Test-754976635 None] Lock "cinder-quobyte-55f6bea3-a346-47cf-b56d-bfd812e9846e" acquired by "delete_volume" :: waited 0.183s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:28:17 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c554818-be9a-4717-9e6d-d19781d95037]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:28:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-90cc4c9d-681c-44ab-9b05-565aca1d824e tempest-GroupSnapshotsV319Test-754976635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:17 devstack quobyte-client[84065]: System call of process 95130 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:28:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-90cc4c9d-681c-44ab-9b05-565aca1d824e tempest-GroupSnapshotsV319Test-754976635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e" returned: 0 in 0.815s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-90cc4c9d-681c-44ab-9b05-565aca1d824e tempest-GroupSnapshotsV319Test-754976635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-90cc4c9d-681c-44ab-9b05-565aca1d824e tempest-GroupSnapshotsV319Test-754976635 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-55f6bea3-a346-47cf-b56d-bfd812e9846e" returned: 0 in 0.133s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-90cc4c9d-681c-44ab-9b05-565aca1d824e tempest-GroupSnapshotsV319Test-754976635 None] Lock "cinder-quobyte-55f6bea3-a346-47cf-b56d-bfd812e9846e" released by "delete_volume" :: held 1.335s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:28:18 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-90cc4c9d-681c-44ab-9b05-565aca1d824e tempest-GroupSnapshotsV319Test-754976635 None] Created reservations ['209e38d7-19b7-4cd1-aba1-f7ec9ff83df2'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:28:19 devstack cinder-volume[84012]: WARNING cinder.quota [None req-90cc4c9d-681c-44ab-9b05-565aca1d824e tempest-GroupSnapshotsV319Test-754976635 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-623124832 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-623124832, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:28:19 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-90cc4c9d-681c-44ab-9b05-565aca1d824e tempest-GroupSnapshotsV319Test-754976635 None] Created reservations ['755452fd-8b9e-459d-8af0-88b9bee0748e', '8d607e6d-86dd-4981-b4a5-6919878d86df', '510403bc-3fee-4373-890d-355e39d2c292', 'c826dd55-ba8e-47fa-acd5-9ab5508ae5d3'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:28:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-90cc4c9d-681c-44ab-9b05-565aca1d824e tempest-GroupSnapshotsV319Test-754976635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:28:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-90cc4c9d-681c-44ab-9b05-565aca1d824e tempest-GroupSnapshotsV319Test-754976635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:28:19 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-90cc4c9d-681c-44ab-9b05-565aca1d824e tempest-GroupSnapshotsV319Test-754976635 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:28:19 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-90cc4c9d-681c-44ab-9b05-565aca1d824e tempest-GroupSnapshotsV319Test-754976635 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:28:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-90cc4c9d-681c-44ab-9b05-565aca1d824e tempest-GroupSnapshotsV319Test-754976635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:28:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-90cc4c9d-681c-44ab-9b05-565aca1d824e tempest-GroupSnapshotsV319Test-754976635 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-90cc4c9d-681c-44ab-9b05-565aca1d824e tempest-GroupSnapshotsV319Test-754976635 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.182s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:19 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-90cc4c9d-681c-44ab-9b05-565aca1d824e tempest-GroupSnapshotsV319Test-754976635 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:28:19 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-90cc4c9d-681c-44ab-9b05-565aca1d824e tempest-GroupSnapshotsV319Test-754976635 None] Delete group completed successfully.
Sep 22 23:28:28 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-14191fd9-d538-4fa8-b808-e1a6cde25738 tempest-GroupsTest-853163666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:28:28 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-14191fd9-d538-4fa8-b808-e1a6cde25738 tempest-GroupsTest-853163666 None] Group tempest-Group1-1244781652: creating
Sep 22 23:28:28 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-14191fd9-d538-4fa8-b808-e1a6cde25738 tempest-GroupsTest-853163666 None] Group tempest-Group1-1244781652: created successfully
Sep 22 23:28:28 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-14191fd9-d538-4fa8-b808-e1a6cde25738 tempest-GroupsTest-853163666 None] Create group completed successfully.
Sep 22 23:28:29 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-d3d38c93-c8a8-44a5-87f1-98a5967633c3 tempest-GroupsTest-853163666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:28:29 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-d3d38c93-c8a8-44a5-87f1-98a5967633c3 tempest-GroupsTest-853163666 None] Group tempest-Group2-1289796170: creating
Sep 22 23:28:29 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-d3d38c93-c8a8-44a5-87f1-98a5967633c3 tempest-GroupsTest-853163666 None] Group tempest-Group2-1289796170: created successfully
Sep 22 23:28:29 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-d3d38c93-c8a8-44a5-87f1-98a5967633c3 tempest-GroupsTest-853163666 None] Create group completed successfully.
Sep 22 23:28:32 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Flow 'volume_create_manager' (ff9065f2-8c29-48f3-b2df-73da0674896d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf40f51-0be9-413c-a2db-ec59d3a4f6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf40f51-0be9-413c-a2db-ec59d3a4f6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1452526547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7b5e9b3e-efc0-4e3d-8447-1245a6d3d046,host='devstack@QuobyteHD#QuobyteHD',id=5cf1efb4-391e-40f7-b468-665aaab60101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6bbcb9240444cff9b19accaae510cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:28:32Z,use_quota=True,user_id='8132ce3558cf41a2a14141d8a6ea3dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef91041b-9b1d-4016-b5cc-20b563496041),volume_type_id=ef91041b-9b1d-4016-b5cc-20b563496041)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d7a40a-f579-45cd-95f0-25eb093bf59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d7a40a-f579-45cd-95f0-25eb093bf59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8579461-1340-431d-93f1-87e51da1bec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8579461-1340-431d-93f1-87e51da1bec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cf1efb4-391e-40f7-b468-665aaab60101', 'volume_name': 'volume-5cf1efb4-391e-40f7-b468-665aaab60101', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07a902f-1be7-4ef6-b0e5-d06dd9a7b077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07a902f-1be7-4ef6-b0e5-d06dd9a7b077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (532fcd88-3bb8-46ee-9765-b81f53a94f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:32 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Volume 5cf1efb4-391e-40f7-b468-665aaab60101: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cf1efb4-391e-40f7-b468-665aaab60101', 'volume_size': 1}
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7b5e9b3e-efc0-4e3d-8447-1245a6d3d046,created_at=2025-09-22T21:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1452526547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7b5e9b3e-efc0-4e3d-8447-1245a6d3d046,host='devstack@QuobyteHD#QuobyteHD',id=5cf1efb4-391e-40f7-b468-665aaab60101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6bbcb9240444cff9b19accaae510cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:28:32Z,use_quota=True,user_id='8132ce3558cf41a2a14141d8a6ea3dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef91041b-9b1d-4016-b5cc-20b563496041),volume_type_id=ef91041b-9b1d-4016-b5cc-20b563496041)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Creating volume 5cf1efb4-391e-40f7-b468-665aaab60101 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:28:32 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:28:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5cf1efb4-391e-40f7-b468-665aaab60101 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:33 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=70, name=volume-5cf1efb4-391e-40f7-b468-665aaab60101, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:28:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5cf1efb4-391e-40f7-b468-665aaab60101 1073741824" returned: 0 in 0.688s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5cf1efb4-391e-40f7-b468-665aaab60101 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5cf1efb4-391e-40f7-b468-665aaab60101" returned: 0 in 0.167s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] <== create_volume: return (991ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:28:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:28:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (532fcd88-3bb8-46ee-9765-b81f53a94f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cf1efb4-391e-40f7-b468-665aaab60101', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b45cb0-3b19-4b0d-a102-cb9ba00d5af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:34 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Volume volume-5cf1efb4-391e-40f7-b468-665aaab60101 (5cf1efb4-391e-40f7-b468-665aaab60101): created successfully
Sep 22 23:28:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b45cb0-3b19-4b0d-a102-cb9ba00d5af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Flow 'volume_create_manager' (ff9065f2-8c29-48f3-b2df-73da0674896d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:28:34 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-007b0eff-a43d-4949-918a-8e28a480136b tempest-GroupsTest-853163666 None] Created volume successfully.
Sep 22 23:28:35 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-e4ca5100-de49-4d6b-9661-4b751c21a2d6 tempest-GroupsTest-853163666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:28:35 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e4ca5100-de49-4d6b-9661-4b751c21a2d6 tempest-GroupsTest-853163666 None] Acquiring lock "cinder-quobyte-5cf1efb4-391e-40f7-b468-665aaab60101" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:28:35 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e4ca5100-de49-4d6b-9661-4b751c21a2d6 tempest-GroupsTest-853163666 None] Lock "cinder-quobyte-5cf1efb4-391e-40f7-b468-665aaab60101" acquired by "delete_volume" :: waited 0.057s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:28:35 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3c5fb8-da14-4c42-8132-d575ad3ff2fe]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:28:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e4ca5100-de49-4d6b-9661-4b751c21a2d6 tempest-GroupsTest-853163666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5cf1efb4-391e-40f7-b468-665aaab60101 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e4ca5100-de49-4d6b-9661-4b751c21a2d6 tempest-GroupsTest-853163666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5cf1efb4-391e-40f7-b468-665aaab60101" returned: 0 in 0.511s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e4ca5100-de49-4d6b-9661-4b751c21a2d6 tempest-GroupsTest-853163666 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5cf1efb4-391e-40f7-b468-665aaab60101 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e4ca5100-de49-4d6b-9661-4b751c21a2d6 tempest-GroupsTest-853163666 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5cf1efb4-391e-40f7-b468-665aaab60101" returned: 0 in 0.105s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:36 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e4ca5100-de49-4d6b-9661-4b751c21a2d6 tempest-GroupsTest-853163666 None] Lock "cinder-quobyte-5cf1efb4-391e-40f7-b468-665aaab60101" released by "delete_volume" :: held 0.877s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:28:37 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-e4ca5100-de49-4d6b-9661-4b751c21a2d6 tempest-GroupsTest-853163666 None] Created reservations ['dfc1a22a-4b8e-43f0-910a-acf665037c04'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:28:37 devstack cinder-volume[84012]: WARNING cinder.quota [None req-e4ca5100-de49-4d6b-9661-4b751c21a2d6 tempest-GroupsTest-853163666 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1398591649 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1398591649, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:28:37 devstack cinder-volume[84012]: WARNING cinder.quota [None req-e4ca5100-de49-4d6b-9661-4b751c21a2d6 tempest-GroupsTest-853163666 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1398591649 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1398591649, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:28:37 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-e4ca5100-de49-4d6b-9661-4b751c21a2d6 tempest-GroupsTest-853163666 None] Created reservations ['0fde6a87-7004-4b3a-97af-2678b614a364', 'dbc9874e-1c95-4a90-ab18-249c9fd07cb8', 'd0a0d2be-3a83-4ec1-a426-671e31d5f57c', '25649233-9898-46ce-a13d-3dd8c853e593'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:28:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e4ca5100-de49-4d6b-9661-4b751c21a2d6 tempest-GroupsTest-853163666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:28:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e4ca5100-de49-4d6b-9661-4b751c21a2d6 tempest-GroupsTest-853163666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:28:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca5100-de49-4d6b-9661-4b751c21a2d6 tempest-GroupsTest-853163666 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:28:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca5100-de49-4d6b-9661-4b751c21a2d6 tempest-GroupsTest-853163666 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:28:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e4ca5100-de49-4d6b-9661-4b751c21a2d6 tempest-GroupsTest-853163666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:28:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e4ca5100-de49-4d6b-9661-4b751c21a2d6 tempest-GroupsTest-853163666 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e4ca5100-de49-4d6b-9661-4b751c21a2d6 tempest-GroupsTest-853163666 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.105s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:37 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-e4ca5100-de49-4d6b-9661-4b751c21a2d6 tempest-GroupsTest-853163666 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:28:37 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-e4ca5100-de49-4d6b-9661-4b751c21a2d6 tempest-GroupsTest-853163666 None] Delete group completed successfully.
Sep 22 23:28:38 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-6bd772a9-9e88-4acb-a3a1-b147ce33322a tempest-GroupsTest-853163666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:28:38 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-6bd772a9-9e88-4acb-a3a1-b147ce33322a tempest-GroupsTest-853163666 None] Created reservations ['90b9bd9d-7a4b-4a71-9174-54b43a831d08'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:28:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6bd772a9-9e88-4acb-a3a1-b147ce33322a tempest-GroupsTest-853163666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:28:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6bd772a9-9e88-4acb-a3a1-b147ce33322a tempest-GroupsTest-853163666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:28:38 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6bd772a9-9e88-4acb-a3a1-b147ce33322a tempest-GroupsTest-853163666 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:28:38 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6bd772a9-9e88-4acb-a3a1-b147ce33322a tempest-GroupsTest-853163666 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:28:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6bd772a9-9e88-4acb-a3a1-b147ce33322a tempest-GroupsTest-853163666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:28:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6bd772a9-9e88-4acb-a3a1-b147ce33322a tempest-GroupsTest-853163666 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6bd772a9-9e88-4acb-a3a1-b147ce33322a tempest-GroupsTest-853163666 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.182s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:38 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-6bd772a9-9e88-4acb-a3a1-b147ce33322a tempest-GroupsTest-853163666 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:28:38 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-6bd772a9-9e88-4acb-a3a1-b147ce33322a tempest-GroupsTest-853163666 None] Delete group completed successfully.
Sep 22 23:28:40 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-e177aaad-6bef-4b44-beac-f9a709fec6a2 req-fa72fba2-0079-42d6-9a72-52d2695dafe5 tempest-AttachVolumeTestJSON-1520125212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:28:40 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-e177aaad-6bef-4b44-beac-f9a709fec6a2 req-fa72fba2-0079-42d6-9a72-52d2695dafe5 tempest-AttachVolumeTestJSON-1520125212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:28:40 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-e177aaad-6bef-4b44-beac-f9a709fec6a2 req-fa72fba2-0079-42d6-9a72-52d2695dafe5 tempest-AttachVolumeTestJSON-1520125212 None] Terminate volume connection completed successfully.
Sep 22 23:28:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-e177aaad-6bef-4b44-beac-f9a709fec6a2 req-fa72fba2-0079-42d6-9a72-52d2695dafe5 tempest-AttachVolumeTestJSON-1520125212 None] Deleting attachment c8535df6-927c-45e7-bdc7-67f4a74b2949. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:28:41 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-84b1b1a7-8a84-4e69-bba2-8423615f6bc2 tempest-GroupsTest-853163666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:28:41 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-84b1b1a7-8a84-4e69-bba2-8423615f6bc2 tempest-GroupsTest-853163666 None] Group tempest-GroupsTest-Group-328046482: creating
Sep 22 23:28:41 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-84b1b1a7-8a84-4e69-bba2-8423615f6bc2 tempest-GroupsTest-853163666 None] Group tempest-GroupsTest-Group-328046482: created successfully
Sep 22 23:28:41 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-84b1b1a7-8a84-4e69-bba2-8423615f6bc2 tempest-GroupsTest-853163666 None] Create group completed successfully.
Sep 22 23:28:43 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Flow 'volume_create_manager' (1745c99a-2c9a-4378-88cc-7598fbbc4005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c27dc9-22b3-4afb-93b6-4cfbd444966d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c27dc9-22b3-4afb-93b6-4cfbd444966d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-24111002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07b7439b-6a40-4d07-ad77-9c299adc682b,host='devstack@QuobyteHD#QuobyteHD',id=ac73b948-8042-466b-a412-cb98bd1cd1ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6bbcb9240444cff9b19accaae510cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:28:43Z,use_quota=True,user_id='8132ce3558cf41a2a14141d8a6ea3dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(753952df-c650-4b71-bf2c-b7a26618187d),volume_type_id=753952df-c650-4b71-bf2c-b7a26618187d)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a617e02f-fda5-4dbb-8899-2800543b58d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a617e02f-fda5-4dbb-8899-2800543b58d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8176846a-1b84-4e4d-8199-f573d08f49b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8176846a-1b84-4e4d-8199-f573d08f49b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac73b948-8042-466b-a412-cb98bd1cd1ef', 'volume_name': 'volume-ac73b948-8042-466b-a412-cb98bd1cd1ef', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c800f6c-c7ad-4c7d-b44c-99ce6b767fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c800f6c-c7ad-4c7d-b44c-99ce6b767fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3844212-553b-4663-88ab-cfd6b9fa7ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:43 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Volume ac73b948-8042-466b-a412-cb98bd1cd1ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac73b948-8042-466b-a412-cb98bd1cd1ef', 'volume_size': 1}
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=07b7439b-6a40-4d07-ad77-9c299adc682b,created_at=2025-09-22T21:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-24111002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07b7439b-6a40-4d07-ad77-9c299adc682b,host='devstack@QuobyteHD#QuobyteHD',id=ac73b948-8042-466b-a412-cb98bd1cd1ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6bbcb9240444cff9b19accaae510cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:28:43Z,use_quota=True,user_id='8132ce3558cf41a2a14141d8a6ea3dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(753952df-c650-4b71-bf2c-b7a26618187d),volume_type_id=753952df-c650-4b71-bf2c-b7a26618187d)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Creating volume ac73b948-8042-466b-a412-cb98bd1cd1ef {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:28:43 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ac73b948-8042-466b-a412-cb98bd1cd1ef 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:43 devstack quobyte-client[84065]: System call of process 95216 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:28:43 devstack quobyte-client[84065]: System call of process 95216 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:28:43 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=71, name=volume-ac73b948-8042-466b-a412-cb98bd1cd1ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ac73b948-8042-466b-a412-cb98bd1cd1ef 1073741824" returned: 0 in 0.494s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ac73b948-8042-466b-a412-cb98bd1cd1ef {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ac73b948-8042-466b-a412-cb98bd1cd1ef" returned: 0 in 0.691s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:44 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] <== create_volume: return (1454ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:28:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:28:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3844212-553b-4663-88ab-cfd6b9fa7ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac73b948-8042-466b-a412-cb98bd1cd1ef', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb23424-e5ec-436b-86b9-833a0be6fd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:46 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Volume volume-ac73b948-8042-466b-a412-cb98bd1cd1ef (ac73b948-8042-466b-a412-cb98bd1cd1ef): created successfully
Sep 22 23:28:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb23424-e5ec-436b-86b9-833a0be6fd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Flow 'volume_create_manager' (1745c99a-2c9a-4378-88cc-7598fbbc4005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:28:46 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-c7884555-09b2-4bbd-b26d-0b1e05c8c6ad tempest-GroupsTest-853163666 None] Created volume successfully.
Sep 22 23:28:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:28:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:28:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:28:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:28:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:28:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:28:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.792s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:28:48 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:28:48 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:28:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Flow 'volume_create_manager' (d952cf20-caba-4e4a-ac6a-b32bd367ea35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:28:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fcf308-6cbb-4afb-8dca-4a674b86355d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fcf308-6cbb-4afb-8dca-4a674b86355d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1046341521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07b7439b-6a40-4d07-ad77-9c299adc682b,host='devstack@QuobyteHD#QuobyteHD',id=93e3eeae-7afc-407e-ba88-0b248ec4f0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6bbcb9240444cff9b19accaae510cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:28:48Z,use_quota=True,user_id='8132ce3558cf41a2a14141d8a6ea3dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(753952df-c650-4b71-bf2c-b7a26618187d),volume_type_id=753952df-c650-4b71-bf2c-b7a26618187d)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c327ab2-5664-478a-90c8-2f1a477efc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c327ab2-5664-478a-90c8-2f1a477efc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea8384a-2a66-460b-9f1e-2f63f6bdeb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea8384a-2a66-460b-9f1e-2f63f6bdeb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93e3eeae-7afc-407e-ba88-0b248ec4f0aa', 'volume_name': 'volume-93e3eeae-7afc-407e-ba88-0b248ec4f0aa', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb8c136-d74e-4db2-96a7-65a1cc0d7f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb8c136-d74e-4db2-96a7-65a1cc0d7f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee74b9f-9313-4d3b-a811-6a8626893532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:49 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Volume 93e3eeae-7afc-407e-ba88-0b248ec4f0aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93e3eeae-7afc-407e-ba88-0b248ec4f0aa', 'volume_size': 1}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=07b7439b-6a40-4d07-ad77-9c299adc682b,created_at=2025-09-22T21:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1046341521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07b7439b-6a40-4d07-ad77-9c299adc682b,host='devstack@QuobyteHD#QuobyteHD',id=93e3eeae-7afc-407e-ba88-0b248ec4f0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6bbcb9240444cff9b19accaae510cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:28:48Z,use_quota=True,user_id='8132ce3558cf41a2a14141d8a6ea3dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(753952df-c650-4b71-bf2c-b7a26618187d),volume_type_id=753952df-c650-4b71-bf2c-b7a26618187d)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Creating volume 93e3eeae-7afc-407e-ba88-0b248ec4f0aa {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:28:49 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-93e3eeae-7afc-407e-ba88-0b248ec4f0aa 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:49 devstack quobyte-client[84065]: System call of process 95281 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:28:49 devstack quobyte-client[84065]: System call of process 95281 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:28:49 devstack quobyte-client[84065]: System call of process 95281 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:28:49 devstack quobyte-client[84065]: System call of process 95281 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:28:49 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=72, name=volume-93e3eeae-7afc-407e-ba88-0b248ec4f0aa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-93e3eeae-7afc-407e-ba88-0b248ec4f0aa 1073741824" returned: 0 in 0.424s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-93e3eeae-7afc-407e-ba88-0b248ec4f0aa {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-93e3eeae-7afc-407e-ba88-0b248ec4f0aa" returned: 0 in 0.100s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] <== create_volume: return (608ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.621s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee74b9f-9313-4d3b-a811-6a8626893532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93e3eeae-7afc-407e-ba88-0b248ec4f0aa', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04673078-3519-4da8-8deb-896e4890f6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:28:50 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Volume volume-93e3eeae-7afc-407e-ba88-0b248ec4f0aa (93e3eeae-7afc-407e-ba88-0b248ec4f0aa): created successfully
Sep 22 23:28:50 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04673078-3519-4da8-8deb-896e4890f6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:28:50 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Flow 'volume_create_manager' (d952cf20-caba-4e4a-ac6a-b32bd367ea35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:28:50 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-eb573f29-2c6b-4793-8f71-62aafc8beb71 tempest-GroupsTest-853163666 None] Created volume successfully.
Sep 22 23:28:50 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-983bc4d8-b172-4c23-84b0-0b0e0208b031 tempest-GroupsTest-853163666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:28:50 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-983bc4d8-b172-4c23-84b0-0b0e0208b031 tempest-GroupsTest-853163666 None] Update group completed successfully.
Sep 22 23:28:52 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-84aa7667-ef4e-40d2-bc6a-2048052b987b tempest-GroupsTest-853163666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:28:52 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-84aa7667-ef4e-40d2-bc6a-2048052b987b tempest-GroupsTest-853163666 None] Update group completed successfully.
Sep 22 23:28:53 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:28:53 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Acquiring lock "cinder-quobyte-93e3eeae-7afc-407e-ba88-0b248ec4f0aa" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:28:53 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Lock "cinder-quobyte-93e3eeae-7afc-407e-ba88-0b248ec4f0aa" acquired by "delete_volume" :: waited 0.111s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:28:54 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc239c5-fae8-484a-a542-769fa2e36662]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:28:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-93e3eeae-7afc-407e-ba88-0b248ec4f0aa {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-93e3eeae-7afc-407e-ba88-0b248ec4f0aa" returned: 0 in 0.482s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-93e3eeae-7afc-407e-ba88-0b248ec4f0aa {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-93e3eeae-7afc-407e-ba88-0b248ec4f0aa" returned: 0 in 0.163s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Lock "cinder-quobyte-93e3eeae-7afc-407e-ba88-0b248ec4f0aa" released by "delete_volume" :: held 0.929s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:28:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Acquiring lock "cinder-quobyte-ac73b948-8042-466b-a412-cb98bd1cd1ef" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:28:55 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Lock "cinder-quobyte-ac73b948-8042-466b-a412-cb98bd1cd1ef" acquired by "delete_volume" :: waited 0.064s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:28:55 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9435cd3-9199-4b92-847a-a05729758b6b]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:28:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ac73b948-8042-466b-a412-cb98bd1cd1ef {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ac73b948-8042-466b-a412-cb98bd1cd1ef" returned: 0 in 0.646s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ac73b948-8042-466b-a412-cb98bd1cd1ef {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ac73b948-8042-466b-a412-cb98bd1cd1ef" returned: 0 in 0.153s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:56 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Lock "cinder-quobyte-ac73b948-8042-466b-a412-cb98bd1cd1ef" released by "delete_volume" :: held 1.113s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:28:56 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Created reservations ['3f2fa44d-644f-401c-ae46-f7deaecaa166'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:28:56 devstack cinder-volume[84012]: WARNING cinder.quota [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-776062867 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-776062867, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:28:56 devstack cinder-volume[84012]: WARNING cinder.quota [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-776062867 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-776062867, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:28:56 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Created reservations ['20cd7b44-9031-4857-abc4-acdcfa08932e', 'a48552dd-79d6-4916-8d5b-d5d8f88a731c', 'e52bda7b-3500-4627-819a-25f4067f1706', 'bc074774-5310-44ee-afbe-8de94d8232d3'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:28:57 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Created reservations ['2668dd1f-97fd-4d0f-a46e-81582b26616c', '9c95ab27-71cf-4a5f-b61d-577184c420f9', 'eec00a18-ed3d-485b-924b-a6af710e807b', 'dac2e787-7a2e-41de-9b20-4c0b0bd5878c'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:28:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:28:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:28:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:28:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:28:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:28:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:28:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.169s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:28:57 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:28:57 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-454d3bc9-ac8f-420b-a92d-b888ead8fc0f tempest-GroupsTest-853163666 None] Delete group completed successfully.
Sep 22 23:29:06 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=64,cinder:SELECT=62,cinder:DELETE=3,cinder:INSERT=17 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:29:06 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-96add8d9-d577-42ed-8883-264e65235e01 tempest-GroupsV320Test-1347843089 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:29:06 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-96add8d9-d577-42ed-8883-264e65235e01 tempest-GroupsV320Test-1347843089 None] Group tempest-GroupsV320Test-Group-741926748: creating
Sep 22 23:29:06 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=65,cinder:SELECT=68,cinder:INSERT=7,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:29:06 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-96add8d9-d577-42ed-8883-264e65235e01 tempest-GroupsV320Test-1347843089 None] Group tempest-GroupsV320Test-Group-741926748: created successfully
Sep 22 23:29:06 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-96add8d9-d577-42ed-8883-264e65235e01 tempest-GroupsV320Test-1347843089 None] Create group completed successfully.
Sep 22 23:29:08 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-c520b77a-d698-4e65-b4b9-525e002efa48 tempest-GroupsV320Test-1347843089 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:29:08 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-c520b77a-d698-4e65-b4b9-525e002efa48 tempest-GroupsV320Test-1347843089 None] Created reservations ['ad48753b-9b36-433b-976e-5abf7abf94f5'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:29:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c520b77a-d698-4e65-b4b9-525e002efa48 tempest-GroupsV320Test-1347843089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:29:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c520b77a-d698-4e65-b4b9-525e002efa48 tempest-GroupsV320Test-1347843089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:29:08 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c520b77a-d698-4e65-b4b9-525e002efa48 tempest-GroupsV320Test-1347843089 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:29:08 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c520b77a-d698-4e65-b4b9-525e002efa48 tempest-GroupsV320Test-1347843089 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:29:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c520b77a-d698-4e65-b4b9-525e002efa48 tempest-GroupsV320Test-1347843089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:29:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c520b77a-d698-4e65-b4b9-525e002efa48 tempest-GroupsV320Test-1347843089 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c520b77a-d698-4e65-b4b9-525e002efa48 tempest-GroupsV320Test-1347843089 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.233s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:08 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-c520b77a-d698-4e65-b4b9-525e002efa48 tempest-GroupsV320Test-1347843089 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:29:09 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-c520b77a-d698-4e65-b4b9-525e002efa48 tempest-GroupsV320Test-1347843089 None] Delete group completed successfully.
Sep 22 23:29:18 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:29:18 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=4,cinder:SELECT=7 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:29:26 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:29:26 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:29:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Flow 'volume_create_manager' (0df9b055-a141-4e58-b2ed-0c04949221a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:29:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6270605-9fe6-4f79-8790-876205619024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:29:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6270605-9fe6-4f79-8790-876205619024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1492900129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59976fce-01d0-409b-93b1-a52cb1cd1129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3060f566b4334b648ccff96d015f91f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:29:27Z,use_quota=True,user_id='4e730cff957d4fe093b1d46437abc088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d248c2ff-c7a3-430e-bc50-70e1141885b3),volume_type_id=d248c2ff-c7a3-430e-bc50-70e1141885b3)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:29:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61dbd3d-88a0-43ad-ba9a-9bdd4cdb9e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:29:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61dbd3d-88a0-43ad-ba9a-9bdd4cdb9e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:29:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341ef9b2-ea70-4757-b860-f19b2f0a4371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:29:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341ef9b2-ea70-4757-b860-f19b2f0a4371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59976fce-01d0-409b-93b1-a52cb1cd1129', 'volume_name': 'volume-59976fce-01d0-409b-93b1-a52cb1cd1129', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:29:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3dc5fb6-f7b6-414d-a6fe-d29a600b3409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:29:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3dc5fb6-f7b6-414d-a6fe-d29a600b3409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:29:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (272ab10e-25ec-45b5-93a7-4e5f6b76b5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:29:27 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Volume 59976fce-01d0-409b-93b1-a52cb1cd1129: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59976fce-01d0-409b-93b1-a52cb1cd1129', 'volume_size': 1}
Sep 22 23:29:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:29:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:29:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1492900129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59976fce-01d0-409b-93b1-a52cb1cd1129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3060f566b4334b648ccff96d015f91f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:29:27Z,use_quota=True,user_id='4e730cff957d4fe093b1d46437abc088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d248c2ff-c7a3-430e-bc50-70e1141885b3),volume_type_id=d248c2ff-c7a3-430e-bc50-70e1141885b3)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:29:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Creating volume 59976fce-01d0-409b-93b1-a52cb1cd1129 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:29:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:29:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:29:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:29:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:29:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:29:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:29:27 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:29:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-59976fce-01d0-409b-93b1-a52cb1cd1129 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:27 devstack quobyte-client[84065]: System call of process 95420 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:29:27 devstack quobyte-client[84065]: System call of process 95420 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:29:27 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=73, name=volume-59976fce-01d0-409b-93b1-a52cb1cd1129, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:29:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-59976fce-01d0-409b-93b1-a52cb1cd1129 1073741824" returned: 0 in 0.826s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-59976fce-01d0-409b-93b1-a52cb1cd1129 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-59976fce-01d0-409b-93b1-a52cb1cd1129" returned: 0 in 0.127s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:28 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] <== create_volume: return (1056ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:29:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:29:28 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (272ab10e-25ec-45b5-93a7-4e5f6b76b5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59976fce-01d0-409b-93b1-a52cb1cd1129', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:29:28 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c523421-faeb-4409-8a68-84e3455e8668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:29:28 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Volume volume-59976fce-01d0-409b-93b1-a52cb1cd1129 (59976fce-01d0-409b-93b1-a52cb1cd1129): created successfully
Sep 22 23:29:28 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c523421-faeb-4409-8a68-84e3455e8668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:29:28 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Flow 'volume_create_manager' (0df9b055-a141-4e58-b2ed-0c04949221a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:29:28 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-1e68ded3-740b-43fc-9131-2edaf2bac334 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Created volume successfully.
Sep 22 23:29:29 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-bf387101-357b-4f42-9971-0491b660689a tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:29:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-bf387101-357b-4f42-9971-0491b660689a tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:29:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-bf387101-357b-4f42-9971-0491b660689a tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:29:30 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-bf387101-357b-4f42-9971-0491b660689a tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:29:30 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-bf387101-357b-4f42-9971-0491b660689a tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:29:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-bf387101-357b-4f42-9971-0491b660689a tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:29:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bf387101-357b-4f42-9971-0491b660689a tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bf387101-357b-4f42-9971-0491b660689a tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.257s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:30 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-bf387101-357b-4f42-9971-0491b660689a tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:29:30 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-bf387101-357b-4f42-9971-0491b660689a tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Retype volume completed successfully.
Sep 22 23:29:31 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Acquiring lock "cinder-59976fce-01d0-409b-93b1-a52cb1cd1129-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:29:31 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Lock "cinder-59976fce-01d0-409b-93b1-a52cb1cd1129-delete_volume" acquired by "delete_volume" :: waited 0.136s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:29:31 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:29:31 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Acquiring lock "cinder-quobyte-59976fce-01d0-409b-93b1-a52cb1cd1129" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:29:32 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Lock "cinder-quobyte-59976fce-01d0-409b-93b1-a52cb1cd1129" acquired by "delete_volume" :: waited 0.020s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:29:32 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb490205-36bc-4b92-8466-0df67e50e799]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:29:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-59976fce-01d0-409b-93b1-a52cb1cd1129 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:33 devstack quobyte-client[84065]: System call of process 95433 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:29:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-59976fce-01d0-409b-93b1-a52cb1cd1129" returned: 0 in 1.358s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-59976fce-01d0-409b-93b1-a52cb1cd1129 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-59976fce-01d0-409b-93b1-a52cb1cd1129" returned: 0 in 0.233s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:34 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Lock "cinder-quobyte-59976fce-01d0-409b-93b1-a52cb1cd1129" released by "delete_volume" :: held 2.031s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:29:34 devstack cinder-volume[84012]: WARNING cinder.quota [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:29:34 devstack cinder-volume[84012]: WARNING cinder.quota [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:29:34 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Created reservations ['13b7d9ef-bec1-42ec-b05f-b48b89aa6399', 'e1080448-02cd-4c72-9c77-f82b9c4e82a4', 'dab4e83c-e80e-4059-88b5-075e229e7bf6', '208cd856-e2f4-40ce-a94c-31cd8e56ed03'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:29:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:29:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:29:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:29:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:29:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:29:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.361s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:35 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:29:35 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Deleted volume successfully.
Sep 22 23:29:36 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-28e594fb-566f-4cdf-805d-311203f16d51 tempest-VolumeRetypeWithoutMigrationTest-1579639391 None] Lock "cinder-59976fce-01d0-409b-93b1-a52cb1cd1129-delete_volume" released by "delete_volume" :: held 4.799s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:29:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-fd3c15e4-4282-43ad-84a0-da075214dca0 req-1dd0db43-88b2-4287-bdf9-d4489677640d tempest-TestServerVolumeAttachmentScenario-380903181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:29:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-fd3c15e4-4282-43ad-84a0-da075214dca0 req-1dd0db43-88b2-4287-bdf9-d4489677640d tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:29:36 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[de238578-f595-414d-be43-fd98b521f35f]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:29:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-fd3c15e4-4282-43ad-84a0-da075214dca0 req-1dd0db43-88b2-4287-bdf9-d4489677640d tempest-TestServerVolumeAttachmentScenario-380903181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7a0cec80-e47e-4073-8c2a-1d181543d248 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:37 devstack quobyte-client[84065]: System call of process 95486 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:29:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-fd3c15e4-4282-43ad-84a0-da075214dca0 req-1dd0db43-88b2-4287-bdf9-d4489677640d tempest-TestServerVolumeAttachmentScenario-380903181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7a0cec80-e47e-4073-8c2a-1d181543d248" returned: 0 in 0.881s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-fd3c15e4-4282-43ad-84a0-da075214dca0 req-1dd0db43-88b2-4287-bdf9-d4489677640d tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.968s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:29:38 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-fd3c15e4-4282-43ad-84a0-da075214dca0 req-1dd0db43-88b2-4287-bdf9-d4489677640d tempest-TestServerVolumeAttachmentScenario-380903181 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-7a0cec80-e47e-4073-8c2a-1d181543d248', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25f8dbac-a90c-4792-a159-8e77bbf1b754', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:29:38 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-fd3c15e4-4282-43ad-84a0-da075214dca0 req-1dd0db43-88b2-4287-bdf9-d4489677640d tempest-TestServerVolumeAttachmentScenario-380903181 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:29:38 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-fd3c15e4-4282-43ad-84a0-da075214dca0 req-1dd0db43-88b2-4287-bdf9-d4489677640d tempest-TestServerVolumeAttachmentScenario-380903181 None] attachment_update completed successfully.
Sep 22 23:29:43 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Flow 'volume_create_manager' (381c82f0-96b0-4fa0-83c5-31fbe5d225c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8c267a-e026-4293-b639-2812d9e9f599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8c267a-e026-4293-b639-2812d9e9f599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1503247144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0576a2-b9c5-4321-9c8c-e96f76aa2eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0f2dd3814347db99c760593e3451b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:29:44Z,use_quota=True,user_id='910833d12d2247a8b9757c94d5ad9b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9132717-56b8-43e1-9931-360a8f435139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9132717-56b8-43e1-9931-360a8f435139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc28d06-31b4-4c29-a054-dba2224c3463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc28d06-31b4-4c29-a054-dba2224c3463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b0576a2-b9c5-4321-9c8c-e96f76aa2eda', 'volume_name': 'volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4c2a28-0ded-4f49-b089-960995c3ca4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4c2a28-0ded-4f49-b089-960995c3ca4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28805197-a1fb-427e-9e16-83311d15d905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:29:43 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Volume 5b0576a2-b9c5-4321-9c8c-e96f76aa2eda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda', 'volume_size': 1}
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1503247144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0576a2-b9c5-4321-9c8c-e96f76aa2eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0f2dd3814347db99c760593e3451b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:29:44Z,use_quota=True,user_id='910833d12d2247a8b9757c94d5ad9b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Creating volume 5b0576a2-b9c5-4321-9c8c-e96f76aa2eda {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:29:43 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:29:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:44 devstack quobyte-client[84065]: System call of process 95879 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:29:44 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=74, name=volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:29:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda 1073741824" returned: 0 in 0.519s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda" returned: 0 in 0.171s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:44 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] <== create_volume: return (804ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:29:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:29:45 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28805197-a1fb-427e-9e16-83311d15d905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:29:45 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0367bb28-bda3-4ae6-a1ef-5035c196e80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:29:45 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Volume volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda (5b0576a2-b9c5-4321-9c8c-e96f76aa2eda): created successfully
Sep 22 23:29:45 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0367bb28-bda3-4ae6-a1ef-5035c196e80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:29:45 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Flow 'volume_create_manager' (381c82f0-96b0-4fa0-83c5-31fbe5d225c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:29:45 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-4b7fea20-862a-4750-a7b1-a614413da2c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Created volume successfully.
Sep 22 23:29:46 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:29:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:29:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:29:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Creating offline snapshot 8adcd4ce-5f11-4655-8c4e-026d8eb4ede1 of volume 5b0576a2-b9c5-4321-9c8c-e96f76aa2eda {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:29:46 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de65911-a8dd-4df7-bf56-167f1ae23e43]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:29:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda" returned: 0 in 0.502s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.8adcd4ce-5f11-4655-8c4e-026d8eb4ede1 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:47 devstack quobyte-client[84065]: System call of process 95888 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:29:47 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=75, name=volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.8adcd4ce-5f11-4655-8c4e-026d8eb4ede1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:29:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.8adcd4ce-5f11-4655-8c4e-026d8eb4ede1 1G" returned: 0 in 0.316s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.8adcd4ce-5f11-4655-8c4e-026d8eb4ede1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:47 devstack quobyte-client[84065]: System call of process 95891 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:29:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] CMD "qemu-img rebase -u -b volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.8adcd4ce-5f11-4655-8c4e-026d8eb4ede1" returned: 0 in 0.233s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.8adcd4ce-5f11-4655-8c4e-026d8eb4ede1 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:29:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.8adcd4ce-5f11-4655-8c4e-026d8eb4ede1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:29:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:29:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:29:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:29:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:29:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:29:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.8adcd4ce-5f11-4655-8c4e-026d8eb4ede1" returned: 0 in 0.377s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:29:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.8adcd4ce-5f11-4655-8c4e-026d8eb4ede1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.263s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:29:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.8adcd4ce-5f11-4655-8c4e-026d8eb4ede1" returned: 0 in 0.220s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.info" returned: 0 in 0.107s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.info is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:29:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.info" returned: 0 in 0.081s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.225s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:29:49 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-7540027e-2dca-4163-ae83-a8daa8f7dd56 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Create snapshot completed successfully
Sep 22 23:29:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Acquiring lock "cinder-8adcd4ce-5f11-4655-8c4e-026d8eb4ede1-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:29:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Lock "cinder-8adcd4ce-5f11-4655-8c4e-026d8eb4ede1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:29:50 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:29:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Acquiring lock "cinder-quobyte-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:29:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Lock "cinder-quobyte-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:29:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Acquiring lock "cinder-quobyte-8adcd4ce-5f11-4655-8c4e-026d8eb4ede1" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:29:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Lock "cinder-quobyte-8adcd4ce-5f11-4655-8c4e-026d8eb4ede1" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:29:50 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Deleting offline snapshot 8adcd4ce-5f11-4655-8c4e-026d8eb4ede1 of volume 5b0576a2-b9c5-4321-9c8c-e96f76aa2eda {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:29:50 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] snapshot_file for this snap is: volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.8adcd4ce-5f11-4655-8c4e-026d8eb4ede1 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:29:50 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[350f428a-98e0-48cf-b53a-3d18ec190a9e]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:29:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.8adcd4ce-5f11-4655-8c4e-026d8eb4ede1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:50 devstack quobyte-client[84065]: System call of process 95899 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:29:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.8adcd4ce-5f11-4655-8c4e-026d8eb4ede1" returned: 0 in 0.463s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:50 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:29:50 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dd4ffc-51a8-45a9-be3e-2d310605d6e2]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:29:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:51 devstack quobyte-client[84065]: System call of process 95902 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:29:51 devstack quobyte-client[84065]: System call of process 95902 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:29:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda" returned: 0 in 0.455s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.8adcd4ce-5f11-4655-8c4e-026d8eb4ede1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.8adcd4ce-5f11-4655-8c4e-026d8eb4ede1" returned: 0 in 0.369s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.8adcd4ce-5f11-4655-8c4e-026d8eb4ede1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda.8adcd4ce-5f11-4655-8c4e-026d8eb4ede1" returned: 0 in 0.201s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Lock "cinder-quobyte-8adcd4ce-5f11-4655-8c4e-026d8eb4ede1" released by "_delete_snapshot" :: held 1.974s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:29:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Lock "cinder-quobyte-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda" released by "delete_snapshot" :: held 2.002s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:29:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-79151d87-f59f-4862-9700-15d082f335b9 req-fd8c0b54-f645-4592-aa5e-20b9e74de552 tempest-TestServerVolumeAttachmentScenario-380903181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:29:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-79151d87-f59f-4862-9700-15d082f335b9 req-fd8c0b54-f645-4592-aa5e-20b9e74de552 tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:29:52 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b119c2-408a-4810-a58b-924e3b183a67]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:29:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-79151d87-f59f-4862-9700-15d082f335b9 req-fd8c0b54-f645-4592-aa5e-20b9e74de552 tempest-TestServerVolumeAttachmentScenario-380903181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0261afdc-8ca5-4672-8184-4673dc9b10f9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:52 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Created reservations ['6d764732-0f05-4011-878f-7c77315489f6', '014f0b7a-5b1e-471c-8ed9-3723ebf72315', '5f884521-e8bc-42b5-930f-594a8ed26c85', '97cdf521-63bb-4478-804c-56c8de10bab8'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:29:53 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Delete snapshot completed successfully.
Sep 22 23:29:53 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6e375bff-85a5-4ade-81c3-65ca8278c2eb tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Lock "cinder-8adcd4ce-5f11-4655-8c4e-026d8eb4ede1-delete_snapshot" released by "delete_snapshot" :: held 2.933s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:29:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-79151d87-f59f-4862-9700-15d082f335b9 req-fd8c0b54-f645-4592-aa5e-20b9e74de552 tempest-TestServerVolumeAttachmentScenario-380903181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0261afdc-8ca5-4672-8184-4673dc9b10f9" returned: 0 in 0.590s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-79151d87-f59f-4862-9700-15d082f335b9 req-fd8c0b54-f645-4592-aa5e-20b9e74de552 tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.637s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:29:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-79151d87-f59f-4862-9700-15d082f335b9 req-fd8c0b54-f645-4592-aa5e-20b9e74de552 tempest-TestServerVolumeAttachmentScenario-380903181 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-0261afdc-8ca5-4672-8184-4673dc9b10f9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7bf1e3db-f7de-4372-bd59-a5892935d731', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:29:53 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-79151d87-f59f-4862-9700-15d082f335b9 req-fd8c0b54-f645-4592-aa5e-20b9e74de552 tempest-TestServerVolumeAttachmentScenario-380903181 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:29:53 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-79151d87-f59f-4862-9700-15d082f335b9 req-fd8c0b54-f645-4592-aa5e-20b9e74de552 tempest-TestServerVolumeAttachmentScenario-380903181 None] attachment_update completed successfully.
Sep 22 23:29:53 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5743d153-a49d-417b-a9d0-b8d27e55b093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Acquiring lock "cinder-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:29:53 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5743d153-a49d-417b-a9d0-b8d27e55b093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Lock "cinder-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:29:53 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-5743d153-a49d-417b-a9d0-b8d27e55b093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:29:53 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5743d153-a49d-417b-a9d0-b8d27e55b093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Acquiring lock "cinder-quobyte-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:29:53 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5743d153-a49d-417b-a9d0-b8d27e55b093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Lock "cinder-quobyte-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda" acquired by "delete_volume" :: waited 0.021s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:29:53 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4afbb1-9f11-4624-99d8-43c71948e21e]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:29:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5743d153-a49d-417b-a9d0-b8d27e55b093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:54 devstack quobyte-client[84065]: System call of process 95924 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:29:54 devstack quobyte-client[84065]: System call of process 95924 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:29:54 devstack quobyte-client[84065]: System call of process 95924 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:29:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5743d153-a49d-417b-a9d0-b8d27e55b093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda" returned: 0 in 0.535s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5743d153-a49d-417b-a9d0-b8d27e55b093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5743d153-a49d-417b-a9d0-b8d27e55b093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda" returned: 0 in 0.098s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5743d153-a49d-417b-a9d0-b8d27e55b093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Lock "cinder-quobyte-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda" released by "delete_volume" :: held 0.833s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:29:54 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-5743d153-a49d-417b-a9d0-b8d27e55b093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Created reservations ['570ff526-3871-4e38-bc05-029bc69e2565', '2a3399d5-e680-4aa8-826a-8af59e02ee05', '7a8799c4-97e1-47e9-b02f-be2a87c3c254', '58e62d74-b87e-4789-81de-45b33bb971fa'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:29:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5743d153-a49d-417b-a9d0-b8d27e55b093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:29:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5743d153-a49d-417b-a9d0-b8d27e55b093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:29:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5743d153-a49d-417b-a9d0-b8d27e55b093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:29:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5743d153-a49d-417b-a9d0-b8d27e55b093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:29:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5743d153-a49d-417b-a9d0-b8d27e55b093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:29:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5743d153-a49d-417b-a9d0-b8d27e55b093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:29:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5743d153-a49d-417b-a9d0-b8d27e55b093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.162s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:29:55 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-5743d153-a49d-417b-a9d0-b8d27e55b093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:29:55 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-5743d153-a49d-417b-a9d0-b8d27e55b093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Deleted volume successfully.
Sep 22 23:29:55 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5743d153-a49d-417b-a9d0-b8d27e55b093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1783697800 None] Lock "cinder-5b0576a2-b9c5-4321-9c8c-e96f76aa2eda-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:30:04 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Flow 'volume_create_manager' (a254fe3a-09f7-4ed3-a63d-80ef02951d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee706c85-3700-4dae-af41-336ae36f6940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee706c85-3700-4dae-af41-336ae36f6940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1476359652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b53f73f-7f06-4c8a-8639-fde94314cf4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1415930f53b4aac9e78225286b5695f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:30:04Z,use_quota=True,user_id='02a40a4a927b46c196a33f7ac0c30877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb549e31-61a3-49ea-b511-ccfdf0aecdb8),volume_type_id=bb549e31-61a3-49ea-b511-ccfdf0aecdb8)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24bf9d4e-79bd-4c9a-bcb7-4ba42e91a7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24bf9d4e-79bd-4c9a-bcb7-4ba42e91a7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a955d7a-181e-4322-8b98-2f27ae414923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a955d7a-181e-4322-8b98-2f27ae414923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b53f73f-7f06-4c8a-8639-fde94314cf4b', 'volume_name': 'volume-1b53f73f-7f06-4c8a-8639-fde94314cf4b', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216efbfc-a226-4c34-b6ef-b0e6dc4be370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216efbfc-a226-4c34-b6ef-b0e6dc4be370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca6eb78-bd39-4a30-a3c6-ec0cdd084537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:30:04 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Volume 1b53f73f-7f06-4c8a-8639-fde94314cf4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b53f73f-7f06-4c8a-8639-fde94314cf4b', 'volume_size': 1}
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1476359652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b53f73f-7f06-4c8a-8639-fde94314cf4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1415930f53b4aac9e78225286b5695f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:30:04Z,use_quota=True,user_id='02a40a4a927b46c196a33f7ac0c30877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb549e31-61a3-49ea-b511-ccfdf0aecdb8),volume_type_id=bb549e31-61a3-49ea-b511-ccfdf0aecdb8)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Creating volume 1b53f73f-7f06-4c8a-8639-fde94314cf4b {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:30:04 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1b53f73f-7f06-4c8a-8639-fde94314cf4b 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:30:04 devstack quobyte-client[84065]: System call of process 95988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:30:04 devstack quobyte-client[84065]: System call of process 95988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:30:04 devstack quobyte-client[84065]: System call of process 95988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:30:04 devstack quobyte-client[84065]: System call of process 95988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:30:04 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=77, name=volume-1b53f73f-7f06-4c8a-8639-fde94314cf4b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1b53f73f-7f06-4c8a-8639-fde94314cf4b 1073741824" returned: 0 in 0.451s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:30:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1b53f73f-7f06-4c8a-8639-fde94314cf4b {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:30:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1b53f73f-7f06-4c8a-8639-fde94314cf4b" returned: 0 in 0.169s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:30:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] <== create_volume: return (704ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:30:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:30:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca6eb78-bd39-4a30-a3c6-ec0cdd084537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b53f73f-7f06-4c8a-8639-fde94314cf4b', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:30:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac38e13b-8974-4211-b381-cb94d783b489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:30:05 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Volume volume-1b53f73f-7f06-4c8a-8639-fde94314cf4b (1b53f73f-7f06-4c8a-8639-fde94314cf4b): created successfully
Sep 22 23:30:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac38e13b-8974-4211-b381-cb94d783b489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:30:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Flow 'volume_create_manager' (a254fe3a-09f7-4ed3-a63d-80ef02951d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:30:05 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-817e3f93-abf3-48d0-a421-a7e37452bbae tempest-VolumeTypesAccessTest-1349261921 None] Created volume successfully.
Sep 22 23:30:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] Acquiring lock "cinder-1b53f73f-7f06-4c8a-8639-fde94314cf4b-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:30:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] Lock "cinder-1b53f73f-7f06-4c8a-8639-fde94314cf4b-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:30:06 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:30:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] Acquiring lock "cinder-quobyte-1b53f73f-7f06-4c8a-8639-fde94314cf4b" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:30:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] Lock "cinder-quobyte-1b53f73f-7f06-4c8a-8639-fde94314cf4b" acquired by "delete_volume" :: waited 0.015s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:30:06 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a490bf-7533-476b-bd0f-8b733fa77642]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:30:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1b53f73f-7f06-4c8a-8639-fde94314cf4b {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:30:07 devstack quobyte-client[84065]: System call of process 95993 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:30:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1b53f73f-7f06-4c8a-8639-fde94314cf4b" returned: 0 in 0.495s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:30:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1b53f73f-7f06-4c8a-8639-fde94314cf4b {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:30:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1b53f73f-7f06-4c8a-8639-fde94314cf4b" returned: 0 in 0.092s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:30:07 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] Lock "cinder-quobyte-1b53f73f-7f06-4c8a-8639-fde94314cf4b" released by "delete_volume" :: held 0.770s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:30:07 devstack cinder-volume[84012]: WARNING cinder.quota [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-452885729 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-452885729, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:30:07 devstack cinder-volume[84012]: WARNING cinder.quota [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-452885729 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-452885729, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:30:07 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] Created reservations ['db66116e-162b-4927-bcda-bce19abb4ba5', '0564efe7-0fd3-44b0-9640-56b936129078', '23a67fb0-5ae6-4cf1-a778-a68405329390', 'fceb90e4-e1d3-49da-8f0d-a338b3855e3f'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:30:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:30:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:30:07 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:30:07 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:30:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:30:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:30:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.104s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:30:08 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:30:08 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] Deleted volume successfully.
Sep 22 23:30:08 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-50b613cf-bf4f-46d5-ad93-848a3bf90077 tempest-VolumeTypesAccessTest-1349261921 None] Lock "cinder-1b53f73f-7f06-4c8a-8639-fde94314cf4b-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:30:17 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=42,cinder:UPDATE=54,cinder:DELETE=3,cinder:INSERT=9 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:30:18 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=34,cinder:SELECT=42,cinder:INSERT=7,cinder:DELETE=4 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:30:22 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-35ee4718-9b11-46d0-a214-b56d4fb0dd90 req-94d95d5c-dfc7-40a7-b1aa-3cca0720d691 tempest-TestServerVolumeAttachmentScenario-380903181 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:30:22 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-35ee4718-9b11-46d0-a214-b56d4fb0dd90 req-94d95d5c-dfc7-40a7-b1aa-3cca0720d691 tempest-TestServerVolumeAttachmentScenario-380903181 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:30:22 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-35ee4718-9b11-46d0-a214-b56d4fb0dd90 req-94d95d5c-dfc7-40a7-b1aa-3cca0720d691 tempest-TestServerVolumeAttachmentScenario-380903181 None] Terminate volume connection completed successfully.
Sep 22 23:30:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-35ee4718-9b11-46d0-a214-b56d4fb0dd90 req-94d95d5c-dfc7-40a7-b1aa-3cca0720d691 tempest-TestServerVolumeAttachmentScenario-380903181 None] Deleting attachment 7bf1e3db-f7de-4372-bd59-a5892935d731. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:30:32 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=2 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:30:32 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:30:47 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-5121e1e0-fb3a-4364-94cf-99c413bd4f0c req-0cd72cb6-de44-4f1c-8f59-ee42e0522324 tempest-TestServerVolumeAttachmentScenario-380903181 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:30:47 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-5121e1e0-fb3a-4364-94cf-99c413bd4f0c req-0cd72cb6-de44-4f1c-8f59-ee42e0522324 tempest-TestServerVolumeAttachmentScenario-380903181 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:30:47 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-5121e1e0-fb3a-4364-94cf-99c413bd4f0c req-0cd72cb6-de44-4f1c-8f59-ee42e0522324 tempest-TestServerVolumeAttachmentScenario-380903181 None] Terminate volume connection completed successfully.
Sep 22 23:30:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-5121e1e0-fb3a-4364-94cf-99c413bd4f0c req-0cd72cb6-de44-4f1c-8f59-ee42e0522324 tempest-TestServerVolumeAttachmentScenario-380903181 None] Deleting attachment 25f8dbac-a90c-4792-a159-8e77bbf1b754. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:30:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:30:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:30:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:30:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:30:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:30:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:30:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:30:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.125s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:30:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:30:57 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=2 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:31:13 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1e65dea4-453e-47ec-b08c-6cba7cce611e tempest-TestServerVolumeAttachmentScenario-380903181 None] Acquiring lock "cinder-0261afdc-8ca5-4672-8184-4673dc9b10f9-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:31:14 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1e65dea4-453e-47ec-b08c-6cba7cce611e tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "cinder-0261afdc-8ca5-4672-8184-4673dc9b10f9-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:31:14 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-1e65dea4-453e-47ec-b08c-6cba7cce611e tempest-TestServerVolumeAttachmentScenario-380903181 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:31:14 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1e65dea4-453e-47ec-b08c-6cba7cce611e tempest-TestServerVolumeAttachmentScenario-380903181 None] Acquiring lock "cinder-quobyte-0261afdc-8ca5-4672-8184-4673dc9b10f9" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:31:14 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1e65dea4-453e-47ec-b08c-6cba7cce611e tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "cinder-quobyte-0261afdc-8ca5-4672-8184-4673dc9b10f9" acquired by "delete_volume" :: waited 0.024s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:31:14 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec036425-d7f8-492b-93bf-294e572dd37a]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:31:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e65dea4-453e-47ec-b08c-6cba7cce611e tempest-TestServerVolumeAttachmentScenario-380903181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0261afdc-8ca5-4672-8184-4673dc9b10f9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:31:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e65dea4-453e-47ec-b08c-6cba7cce611e tempest-TestServerVolumeAttachmentScenario-380903181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0261afdc-8ca5-4672-8184-4673dc9b10f9" returned: 0 in 0.808s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:31:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e65dea4-453e-47ec-b08c-6cba7cce611e tempest-TestServerVolumeAttachmentScenario-380903181 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0261afdc-8ca5-4672-8184-4673dc9b10f9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:31:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e65dea4-453e-47ec-b08c-6cba7cce611e tempest-TestServerVolumeAttachmentScenario-380903181 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0261afdc-8ca5-4672-8184-4673dc9b10f9" returned: 0 in 0.180s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:31:15 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1e65dea4-453e-47ec-b08c-6cba7cce611e tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "cinder-quobyte-0261afdc-8ca5-4672-8184-4673dc9b10f9" released by "delete_volume" :: held 1.338s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:31:16 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-1e65dea4-453e-47ec-b08c-6cba7cce611e tempest-TestServerVolumeAttachmentScenario-380903181 None] Created reservations ['ddc4401f-6810-46cb-a378-d6431bac2894', '46b3fac4-600a-476d-905f-db5960006b9e', '474324db-29d0-4c6d-85c2-e03499e97b67', 'dcd67738-5580-4578-9a4b-58a418ca3141'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:31:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1e65dea4-453e-47ec-b08c-6cba7cce611e tempest-TestServerVolumeAttachmentScenario-380903181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:31:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1e65dea4-453e-47ec-b08c-6cba7cce611e tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:31:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1e65dea4-453e-47ec-b08c-6cba7cce611e tempest-TestServerVolumeAttachmentScenario-380903181 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:31:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1e65dea4-453e-47ec-b08c-6cba7cce611e tempest-TestServerVolumeAttachmentScenario-380903181 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:31:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1e65dea4-453e-47ec-b08c-6cba7cce611e tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:31:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e65dea4-453e-47ec-b08c-6cba7cce611e tempest-TestServerVolumeAttachmentScenario-380903181 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:31:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0680a723-4120-4889-885a-09042d638749 tempest-TestServerVolumeAttachmentScenario-380903181 None] Acquiring lock "cinder-7a0cec80-e47e-4073-8c2a-1d181543d248-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:31:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e65dea4-453e-47ec-b08c-6cba7cce611e tempest-TestServerVolumeAttachmentScenario-380903181 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.623s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:31:17 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-1e65dea4-453e-47ec-b08c-6cba7cce611e tempest-TestServerVolumeAttachmentScenario-380903181 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:31:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0680a723-4120-4889-885a-09042d638749 tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "cinder-7a0cec80-e47e-4073-8c2a-1d181543d248-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:31:17 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-1e65dea4-453e-47ec-b08c-6cba7cce611e tempest-TestServerVolumeAttachmentScenario-380903181 None] Deleted volume successfully.
Sep 22 23:31:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1e65dea4-453e-47ec-b08c-6cba7cce611e tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "cinder-0261afdc-8ca5-4672-8184-4673dc9b10f9-delete_volume" released by "delete_volume" :: held 3.389s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:31:17 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-0680a723-4120-4889-885a-09042d638749 tempest-TestServerVolumeAttachmentScenario-380903181 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:31:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0680a723-4120-4889-885a-09042d638749 tempest-TestServerVolumeAttachmentScenario-380903181 None] Acquiring lock "cinder-quobyte-7a0cec80-e47e-4073-8c2a-1d181543d248" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:31:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0680a723-4120-4889-885a-09042d638749 tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "cinder-quobyte-7a0cec80-e47e-4073-8c2a-1d181543d248" acquired by "delete_volume" :: waited 0.022s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:31:17 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e142bbd6-7068-4cf2-9836-e863f6cba166]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:31:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0680a723-4120-4889-885a-09042d638749 tempest-TestServerVolumeAttachmentScenario-380903181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7a0cec80-e47e-4073-8c2a-1d181543d248 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:31:18 devstack quobyte-client[84065]: System call of process 96284 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:31:18 devstack quobyte-client[84065]: System call of process 96284 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:31:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0680a723-4120-4889-885a-09042d638749 tempest-TestServerVolumeAttachmentScenario-380903181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7a0cec80-e47e-4073-8c2a-1d181543d248" returned: 0 in 0.571s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:31:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0680a723-4120-4889-885a-09042d638749 tempest-TestServerVolumeAttachmentScenario-380903181 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7a0cec80-e47e-4073-8c2a-1d181543d248 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:31:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0680a723-4120-4889-885a-09042d638749 tempest-TestServerVolumeAttachmentScenario-380903181 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7a0cec80-e47e-4073-8c2a-1d181543d248" returned: 0 in 0.137s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:31:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0680a723-4120-4889-885a-09042d638749 tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "cinder-quobyte-7a0cec80-e47e-4073-8c2a-1d181543d248" released by "delete_volume" :: held 0.993s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:31:18 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-0680a723-4120-4889-885a-09042d638749 tempest-TestServerVolumeAttachmentScenario-380903181 None] Created reservations ['8831ccf7-35e1-4db5-8288-2b18bb0aa168', 'ef49a34d-0882-44b8-bc79-99150f1c357f', 'a159ded0-a3aa-48ee-95f9-a25ee8e8257f', '95eaaa0b-32ad-4643-9bef-ff5772b781a1'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:31:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0680a723-4120-4889-885a-09042d638749 tempest-TestServerVolumeAttachmentScenario-380903181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:31:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0680a723-4120-4889-885a-09042d638749 tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:31:19 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0680a723-4120-4889-885a-09042d638749 tempest-TestServerVolumeAttachmentScenario-380903181 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:31:19 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0680a723-4120-4889-885a-09042d638749 tempest-TestServerVolumeAttachmentScenario-380903181 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:31:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0680a723-4120-4889-885a-09042d638749 tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:31:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0680a723-4120-4889-885a-09042d638749 tempest-TestServerVolumeAttachmentScenario-380903181 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:31:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0680a723-4120-4889-885a-09042d638749 tempest-TestServerVolumeAttachmentScenario-380903181 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.230s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:31:19 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-0680a723-4120-4889-885a-09042d638749 tempest-TestServerVolumeAttachmentScenario-380903181 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:31:19 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-0680a723-4120-4889-885a-09042d638749 tempest-TestServerVolumeAttachmentScenario-380903181 None] Deleted volume successfully.
Sep 22 23:31:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0680a723-4120-4889-885a-09042d638749 tempest-TestServerVolumeAttachmentScenario-380903181 None] Lock "cinder-7a0cec80-e47e-4073-8c2a-1d181543d248-delete_volume" released by "delete_volume" :: held 3.042s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:31:29 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=11,cinder:SELECT=7,cinder:INSERT=5 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:31:30 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=13,cinder:INSERT=3,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:31:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:31:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:31:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:31:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:31:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:31:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.080s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:31:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:31:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.430s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:31:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:31:53 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:31:53 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:31:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Flow 'volume_create_manager' (2e62661d-bbb2-4350-931e-0f681e6e847a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:31:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd375c8-0b91-4898-9382-e503be484160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:31:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd375c8-0b91-4898-9382-e503be484160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2558b1-bdcf-4e66-8f00-34c94eeec437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed7ffebb556435aaa0df927106e1b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:31:53Z,use_quota=True,user_id='bb8be1e6197045368b99229db5bde459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:31:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d00904-fc27-4431-a2e4-ae338632e7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:31:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d00904-fc27-4431-a2e4-ae338632e7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:31:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f9b5d4e-d8d6-4131-98eb-6a9c2cdf5476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:31:53 devstack cinder-volume[84012]: DEBUG cinder.image.glance [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Creating Keystone auth plugin from conf {{(pid=84012) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 22 23:31:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f9b5d4e-d8d6-4131-98eb-6a9c2cdf5476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7b2558b1-bdcf-4e66-8f00-34c94eeec437', 'volume_name': 'volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437', 'volume_size': 1, 'image_id': 'b5caa763-33c6-40dd-b41c-6610b84a5742', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5caa763-33c6-40dd-b41c-6610b84a5742', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '54a2b7e41397f3733f3111e36259339c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2ed7ffebb556435aaa0df927106e1b87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7a2cb92e382701d130c375bda2b77c6c773bd88980842021d3e861de1035e5eca06adec3f1423ebfe1c484bdbd9d150449fbaed4c72c47a9ead6c3bbd14f473c', 'id': 'b5caa763-33c6-40dd-b41c-6610b84a5742', 'created_at': datetime.datetime(2025, 9, 22, 21, 31, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 21, 31, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5caa763-33c6-40dd-b41c-6610b84a5742/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0d053ca8c0>}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:31:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b885e5-43f5-41d1-9ec3-c99f0bee5370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:31:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b885e5-43f5-41d1-9ec3-c99f0bee5370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:31:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b33487a2-5b1d-4f57-a1cb-45d4e7f55560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:31:54 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Volume 7b2558b1-bdcf-4e66-8f00-34c94eeec437: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437', 'volume_size': 1, 'image_id': 'b5caa763-33c6-40dd-b41c-6610b84a5742', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5caa763-33c6-40dd-b41c-6610b84a5742', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '54a2b7e41397f3733f3111e36259339c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2ed7ffebb556435aaa0df927106e1b87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7a2cb92e382701d130c375bda2b77c6c773bd88980842021d3e861de1035e5eca06adec3f1423ebfe1c484bdbd9d150449fbaed4c72c47a9ead6c3bbd14f473c', 'id': 'b5caa763-33c6-40dd-b41c-6610b84a5742', 'created_at': datetime.datetime(2025, 9, 22, 21, 31, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 21, 31, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5caa763-33c6-40dd-b41c-6610b84a5742/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0d053ca8c0>}
Sep 22 23:31:54 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Cloning 7b2558b1-bdcf-4e66-8f00-34c94eeec437 from image b5caa763-33c6-40dd-b41c-6610b84a5742  at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5caa763-33c6-40dd-b41c-6610b84a5742', 'metadata': {}}]). {{(pid=84012) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 22 23:31:54 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84012) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 22 23:31:54 devstack cinder-volume[84012]: INFO cinder.image.image_utils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Image download 0.00 MB at 0.00 MB/s
Sep 22 23:31:54 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[210b1cb5-e2b1-4a4c-b856-9e491a4cd93b]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:31:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:31:54 devstack sudo[96498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD
Sep 22 23:31:54 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:31:57 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:31:57 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Flow 'volume_create_manager' (9c63d88d-4393-46a7-b7d9-1985d2eb0e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73ab465-d3d9-4a32-b053-808aba5bc44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73ab465-d3d9-4a32-b053-808aba5bc44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1436374528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=953c9b98-e84f-4281-8b9a-db3c499c01cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0835dfd136484fa4c6cc9be30f28a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:31:57Z,use_quota=True,user_id='5c319f819410453abdc9a6afc334927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99700808-07ee-4be8-bd21-ef4c54b2e540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99700808-07ee-4be8-bd21-ef4c54b2e540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f099914-8c5f-41d7-a78b-f5870fcbb0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f099914-8c5f-41d7-a78b-f5870fcbb0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '953c9b98-e84f-4281-8b9a-db3c499c01cf', 'volume_name': 'volume-953c9b98-e84f-4281-8b9a-db3c499c01cf', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bf900a-886c-4617-8260-9c8828436bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bf900a-886c-4617-8260-9c8828436bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea029d49-4aa2-47c2-93e2-851007345c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:31:57 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Volume 953c9b98-e84f-4281-8b9a-db3c499c01cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-953c9b98-e84f-4281-8b9a-db3c499c01cf', 'volume_size': 1}
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1436374528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=953c9b98-e84f-4281-8b9a-db3c499c01cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0835dfd136484fa4c6cc9be30f28a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:31:57Z,use_quota=True,user_id='5c319f819410453abdc9a6afc334927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Creating volume 953c9b98-e84f-4281-8b9a-db3c499c01cf {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:31:57 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:31:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-953c9b98-e84f-4281-8b9a-db3c499c01cf 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:31:57 devstack quobyte-client[84065]: System call of process 96511 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:31:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD" returned: 0 in 3.696s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:31:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:31:58 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=78, name=volume-953c9b98-e84f-4281-8b9a-db3c499c01cf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:31:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-953c9b98-e84f-4281-8b9a-db3c499c01cf 1073741824" returned: 0 in 0.731s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:31:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-953c9b98-e84f-4281-8b9a-db3c499c01cf {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:31:58 devstack sudo[96513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD
Sep 22 23:31:58 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:31:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-953c9b98-e84f-4281-8b9a-db3c499c01cf" returned: 0 in 0.279s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:31:58 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] <== create_volume: return (1145ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:31:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:31:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea029d49-4aa2-47c2-93e2-851007345c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-953c9b98-e84f-4281-8b9a-db3c499c01cf', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:31:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ceb0da6-9132-408f-ad48-314a1338137a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:31:59 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Volume volume-953c9b98-e84f-4281-8b9a-db3c499c01cf (953c9b98-e84f-4281-8b9a-db3c499c01cf): created successfully
Sep 22 23:31:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ceb0da6-9132-408f-ad48-314a1338137a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:31:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Flow 'volume_create_manager' (9c63d88d-4393-46a7-b7d9-1985d2eb0e2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:31:59 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-08dd5c39-d739-43e6-afc9-a060239170d5 tempest-VolumesActionsTest-1516758871 None] Created volume successfully.
Sep 22 23:32:00 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5a7838b9-3ca2-40dc-914b-1c2d9fd993cf tempest-VolumesActionsTest-1516758871 None] Acquiring lock "cinder-953c9b98-e84f-4281-8b9a-db3c499c01cf" by "attach_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:00 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5a7838b9-3ca2-40dc-914b-1c2d9fd993cf tempest-VolumesActionsTest-1516758871 None] Lock "cinder-953c9b98-e84f-4281-8b9a-db3c499c01cf" acquired by "attach_volume" :: waited 0.067s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:01 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-5a7838b9-3ca2-40dc-914b-1c2d9fd993cf tempest-VolumesActionsTest-1516758871 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:01 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-5a7838b9-3ca2-40dc-914b-1c2d9fd993cf tempest-VolumesActionsTest-1516758871 None] Attaching volume 953c9b98-e84f-4281-8b9a-db3c499c01cf to instance 13aefb0c-9c77-466e-9bd8-f67c07fe4b26 at mountpoint /dev/vdb on host None.
Sep 22 23:32:01 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-5a7838b9-3ca2-40dc-914b-1c2d9fd993cf tempest-VolumesActionsTest-1516758871 None] Attach volume completed successfully.
Sep 22 23:32:01 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5a7838b9-3ca2-40dc-914b-1c2d9fd993cf tempest-VolumesActionsTest-1516758871 None] Lock "cinder-953c9b98-e84f-4281-8b9a-db3c499c01cf" released by "attach_volume" :: held 1.145s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:01 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root
Sep 22 23:32:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD" returned: 1 in 3.640s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:32:01 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Temporary image b5caa763-33c6-40dd-b41c-6610b84a5742 is fetched for user bb8be1e6197045368b99229db5bde459. {{(pid=84012) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 22 23:32:01 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b1c646-c3f1-49d6-9064-c7b736dd8bfb]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:32:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:02 devstack sudo[96528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD
Sep 22 23:32:02 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:32:02 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-0dd461f6-b2df-4543-b197-c6481226878b tempest-VolumesActionsTest-1305307659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:03 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-0dd461f6-b2df-4543-b197-c6481226878b tempest-VolumesActionsTest-1305307659 None] Terminate volume connection completed successfully.
Sep 22 23:32:03 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0dd461f6-b2df-4543-b197-c6481226878b tempest-VolumesActionsTest-1305307659 None] Acquiring lock "cinder-953c9b98-e84f-4281-8b9a-db3c499c01cf-detach_volume" by "detach_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:03 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0dd461f6-b2df-4543-b197-c6481226878b tempest-VolumesActionsTest-1305307659 None] Lock "cinder-953c9b98-e84f-4281-8b9a-db3c499c01cf-detach_volume" acquired by "detach_volume" :: waited 0.124s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:04 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-0dd461f6-b2df-4543-b197-c6481226878b tempest-VolumesActionsTest-1305307659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:04 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-0dd461f6-b2df-4543-b197-c6481226878b tempest-VolumesActionsTest-1305307659 None] Detaching volume 953c9b98-e84f-4281-8b9a-db3c499c01cf from instance 13aefb0c-9c77-466e-9bd8-f67c07fe4b26.
Sep 22 23:32:04 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-0dd461f6-b2df-4543-b197-c6481226878b tempest-VolumesActionsTest-1305307659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:04 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-0dd461f6-b2df-4543-b197-c6481226878b tempest-VolumesActionsTest-1305307659 None] Detach volume completed successfully.
Sep 22 23:32:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0dd461f6-b2df-4543-b197-c6481226878b tempest-VolumesActionsTest-1305307659 None] Lock "cinder-953c9b98-e84f-4281-8b9a-db3c499c01cf-detach_volume" released by "detach_volume" :: held 0.390s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:05 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-79bcb150-a076-4c1b-9d1b-7927f961165a tempest-VolumesActionsTest-1516758871 None] Acquiring lock "cinder-953c9b98-e84f-4281-8b9a-db3c499c01cf-detach_volume" by "detach_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:05 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-79bcb150-a076-4c1b-9d1b-7927f961165a tempest-VolumesActionsTest-1516758871 None] Lock "cinder-953c9b98-e84f-4281-8b9a-db3c499c01cf-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:05 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-79bcb150-a076-4c1b-9d1b-7927f961165a tempest-VolumesActionsTest-1516758871 None] Volume detach called, but volume not attached.
Sep 22 23:32:05 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-79bcb150-a076-4c1b-9d1b-7927f961165a tempest-VolumesActionsTest-1516758871 None] Lock "cinder-953c9b98-e84f-4281-8b9a-db3c499c01cf-detach_volume" released by "detach_volume" :: held 0.069s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:05 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root
Sep 22 23:32:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD" returned: 0 in 3.643s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:06 devstack sudo[96533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD
Sep 22 23:32:06 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:32:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6e4f7237-8de8-4a4d-b491-3c015f979745 tempest-VolumesActionsTest-1516758871 None] Acquiring lock "cinder-953c9b98-e84f-4281-8b9a-db3c499c01cf-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6e4f7237-8de8-4a4d-b491-3c015f979745 tempest-VolumesActionsTest-1516758871 None] Lock "cinder-953c9b98-e84f-4281-8b9a-db3c499c01cf-delete_volume" acquired by "delete_volume" :: waited 0.170s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:07 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-6e4f7237-8de8-4a4d-b491-3c015f979745 tempest-VolumesActionsTest-1516758871 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:07 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6e4f7237-8de8-4a4d-b491-3c015f979745 tempest-VolumesActionsTest-1516758871 None] Acquiring lock "cinder-quobyte-953c9b98-e84f-4281-8b9a-db3c499c01cf" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:07 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6e4f7237-8de8-4a4d-b491-3c015f979745 tempest-VolumesActionsTest-1516758871 None] Lock "cinder-quobyte-953c9b98-e84f-4281-8b9a-db3c499c01cf" acquired by "delete_volume" :: waited 0.046s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:07 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[44178a4a-0b98-48e6-b7ad-39119e61d755]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:32:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6e4f7237-8de8-4a4d-b491-3c015f979745 tempest-VolumesActionsTest-1516758871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-953c9b98-e84f-4281-8b9a-db3c499c01cf {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:08 devstack quobyte-client[84065]: System call of process 96535 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:08 devstack quobyte-client[84065]: System call of process 96535 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:08 devstack quobyte-client[84065]: System call of process 96535 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6e4f7237-8de8-4a4d-b491-3c015f979745 tempest-VolumesActionsTest-1516758871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-953c9b98-e84f-4281-8b9a-db3c499c01cf" returned: 0 in 1.471s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6e4f7237-8de8-4a4d-b491-3c015f979745 tempest-VolumesActionsTest-1516758871 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-953c9b98-e84f-4281-8b9a-db3c499c01cf {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6e4f7237-8de8-4a4d-b491-3c015f979745 tempest-VolumesActionsTest-1516758871 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-953c9b98-e84f-4281-8b9a-db3c499c01cf" returned: 0 in 0.190s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:09 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6e4f7237-8de8-4a4d-b491-3c015f979745 tempest-VolumesActionsTest-1516758871 None] Lock "cinder-quobyte-953c9b98-e84f-4281-8b9a-db3c499c01cf" released by "delete_volume" :: held 2.253s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:10 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-6e4f7237-8de8-4a4d-b491-3c015f979745 tempest-VolumesActionsTest-1516758871 None] Created reservations ['a9f75e54-9a7f-4329-89ca-f84f91ff25ec', '26c3551d-12ec-45d2-b3ca-85c6af3f6cb9', '713e5827-0743-48c8-bdea-3add3165f169', '679ea187-b1f0-4f1f-ab93-1066e1a7afef'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:32:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6e4f7237-8de8-4a4d-b491-3c015f979745 tempest-VolumesActionsTest-1516758871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6e4f7237-8de8-4a4d-b491-3c015f979745 tempest-VolumesActionsTest-1516758871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:10 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6e4f7237-8de8-4a4d-b491-3c015f979745 tempest-VolumesActionsTest-1516758871 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:32:10 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6e4f7237-8de8-4a4d-b491-3c015f979745 tempest-VolumesActionsTest-1516758871 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:32:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6e4f7237-8de8-4a4d-b491-3c015f979745 tempest-VolumesActionsTest-1516758871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.081s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6e4f7237-8de8-4a4d-b491-3c015f979745 tempest-VolumesActionsTest-1516758871 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6e4f7237-8de8-4a4d-b491-3c015f979745 tempest-VolumesActionsTest-1516758871 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.294s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:10 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-6e4f7237-8de8-4a4d-b491-3c015f979745 tempest-VolumesActionsTest-1516758871 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:32:10 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root
Sep 22 23:32:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD" returned: 1 in 5.390s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:32:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:11 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2558b1-bdcf-4e66-8f00-34c94eeec437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed7ffebb556435aaa0df927106e1b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:31:53Z,use_quota=True,user_id='bb8be1e6197045368b99229db5bde459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:32:11 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Creating volume 7b2558b1-bdcf-4e66-8f00-34c94eeec437 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:32:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:11 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:32:11 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:32:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:11 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:32:11 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:32:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:11 devstack quobyte-client[84065]: System call of process 96543 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:11 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=79, name=volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:32:11 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-6e4f7237-8de8-4a4d-b491-3c015f979745 tempest-VolumesActionsTest-1516758871 None] Deleted volume successfully.
Sep 22 23:32:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437 1073741824" returned: 0 in 1.043s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6e4f7237-8de8-4a4d-b491-3c015f979745 tempest-VolumesActionsTest-1516758871 None] Lock "cinder-953c9b98-e84f-4281-8b9a-db3c499c01cf-delete_volume" released by "delete_volume" :: held 5.947s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437" returned: 0 in 0.469s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:12 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] <== create_volume: return (1562ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:32:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:12 devstack cinder-volume[84012]: DEBUG cinder.volume.volume_utils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Attempting download of b5caa763-33c6-40dd-b41c-6610b84a5742 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5caa763-33c6-40dd-b41c-6610b84a5742', 'metadata': {}}])) to volume 7b2558b1-bdcf-4e66-8f00-34c94eeec437. {{(pid=84012) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 22 23:32:13 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e80dc99-89c1-474a-a9ae-346cb81a253c]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:32:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5caa763-33c6-40dd-b41c-6610b84a5742_f3e_4bf1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5caa763-33c6-40dd-b41c-6610b84a5742_f3e_4bf1" returned: 0 in 1.816s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5caa763-33c6-40dd-b41c-6610b84a5742_f3e_4bf1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5caa763-33c6-40dd-b41c-6610b84a5742_f3e_4bf1" returned: 1 in 1.521s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5caa763-33c6-40dd-b41c-6610b84a5742_f3e_4bf1' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:32:17 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2d36b3-e423-496c-b443-1a739635071d]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:32:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:17 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:17 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Flow 'volume_create_manager' (d14d4dce-71bf-4f65-ad8b-f824c3ad23ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bfa224-85cd-470d-8ad0-9ed1365aff4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bfa224-85cd-470d-8ad0-9ed1365aff4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1007515478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082c036e-7fdb-4f4c-82a9-395ea04ffdc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d292b4ecb74117b122728be5976e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:32:16Z,use_quota=True,user_id='9d89dd62c2ef43daa5145ce3cddd10a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30db82b2-3038-490a-8fc4-9ff0c41fb5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30db82b2-3038-490a-8fc4-9ff0c41fb5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4721e7f-1758-402f-8364-3704098b5130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4721e7f-1758-402f-8364-3704098b5130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '082c036e-7fdb-4f4c-82a9-395ea04ffdc4', 'volume_name': 'volume-082c036e-7fdb-4f4c-82a9-395ea04ffdc4', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec32543-77f2-4dc3-9c96-5e9beafd380e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec32543-77f2-4dc3-9c96-5e9beafd380e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4e1c20-b7da-4b72-ac7f-74dd99026c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:18 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Volume 082c036e-7fdb-4f4c-82a9-395ea04ffdc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-082c036e-7fdb-4f4c-82a9-395ea04ffdc4', 'volume_size': 1}
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1007515478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082c036e-7fdb-4f4c-82a9-395ea04ffdc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d292b4ecb74117b122728be5976e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:32:16Z,use_quota=True,user_id='9d89dd62c2ef43daa5145ce3cddd10a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Creating volume 082c036e-7fdb-4f4c-82a9-395ea04ffdc4 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:32:18 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-082c036e-7fdb-4f4c-82a9-395ea04ffdc4 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD" returned: 0 in 1.576s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:18 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=80, name=volume-082c036e-7fdb-4f4c-82a9-395ea04ffdc4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:32:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-082c036e-7fdb-4f4c-82a9-395ea04ffdc4 1073741824" returned: 0 in 0.837s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-082c036e-7fdb-4f4c-82a9-395ea04ffdc4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD" returned: 1 in 1.193s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:32:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-082c036e-7fdb-4f4c-82a9-395ea04ffdc4" returned: 0 in 0.480s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:20 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] b5caa763-33c6-40dd-b41c-6610b84a5742 was raw, converting to raw {{(pid=84012) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 22 23:32:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] <== create_volume: return (1551ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:32:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:20 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=79, name=volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:32:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4e1c20-b7da-4b72-ac7f-74dd99026c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-082c036e-7fdb-4f4c-82a9-395ea04ffdc4', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b079275c-35fc-40ed-8b90-a74be11ab83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437" returned: 0 in 0.418s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:20 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5caa763-33c6-40dd-b41c-6610b84a5742_6e3lqbcmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437 {{(pid=84012) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 22 23:32:20 devstack cinder-volume[84012]: INFO cinder.image.image_utils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Converted 0.00 MB image at 0.00 MB/s
Sep 22 23:32:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:20 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Volume volume-082c036e-7fdb-4f4c-82a9-395ea04ffdc4 (082c036e-7fdb-4f4c-82a9-395ea04ffdc4): created successfully
Sep 22 23:32:20 devstack quobyte-client[84065]: System call of process 96607 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b079275c-35fc-40ed-8b90-a74be11ab83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Flow 'volume_create_manager' (d14d4dce-71bf-4f65-ad8b-f824c3ad23ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:32:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437 1G" returned: 0 in 0.333s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:21 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-fb9fa7b5-0c20-467e-91e9-135e9639cfbe tempest-AttachVolumeTestJSON-1520125212 None] Created volume successfully.
Sep 22 23:32:21 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d04b910-eebf-4fda-8e9e-b47d11fa5826]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:32:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437" returned: 0 in 0.416s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437" returned: 1 in 0.417s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:32:22 devstack cinder-volume[84012]: DEBUG cinder.volume.volume_utils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Downloaded image b5caa763-33c6-40dd-b41c-6610b84a5742 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5caa763-33c6-40dd-b41c-6610b84a5742', 'metadata': {}}])) to volume 7b2558b1-bdcf-4e66-8f00-34c94eeec437 successfully. {{(pid=84012) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 22 23:32:22 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Temporary image b5caa763-33c6-40dd-b41c-6610b84a5742 for user bb8be1e6197045368b99229db5bde459 is deleted. {{(pid=84012) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 22 23:32:22 devstack cinder-volume[84012]: DEBUG cinder.volume.volume_utils [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Marking volume 7b2558b1-bdcf-4e66-8f00-34c94eeec437 as bootable. {{(pid=84012) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 22 23:32:22 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Copying metadata from image b5caa763-33c6-40dd-b41c-6610b84a5742 to 7b2558b1-bdcf-4e66-8f00-34c94eeec437. {{(pid=84012) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 22 23:32:22 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Creating volume glance metadata for volume 7b2558b1-bdcf-4e66-8f00-34c94eeec437 backed by image b5caa763-33c6-40dd-b41c-6610b84a5742 with: {'image_id': 'b5caa763-33c6-40dd-b41c-6610b84a5742', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '54a2b7e41397f3733f3111e36259339c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84012) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 22 23:32:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b33487a2-5b1d-4f57-a1cb-45d4e7f55560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437', 'volume_size': 1, 'image_id': 'b5caa763-33c6-40dd-b41c-6610b84a5742', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5caa763-33c6-40dd-b41c-6610b84a5742', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '54a2b7e41397f3733f3111e36259339c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2ed7ffebb556435aaa0df927106e1b87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7a2cb92e382701d130c375bda2b77c6c773bd88980842021d3e861de1035e5eca06adec3f1423ebfe1c484bdbd9d150449fbaed4c72c47a9ead6c3bbd14f473c', 'id': 'b5caa763-33c6-40dd-b41c-6610b84a5742', 'created_at': datetime.datetime(2025, 9, 22, 21, 31, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 21, 31, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5caa763-33c6-40dd-b41c-6610b84a5742/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0d053ca8c0>}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9ba999-426e-4eb1-93ed-59f4666fbbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:22 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Volume volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437 (7b2558b1-bdcf-4e66-8f00-34c94eeec437): created successfully
Sep 22 23:32:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9ba999-426e-4eb1-93ed-59f4666fbbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Flow 'volume_create_manager' (2e62661d-bbb2-4350-931e-0f681e6e847a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:32:22 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-f53420cb-410b-4f74-acdb-263a5d235e10 tempest-VolumeImageDependencyTests-1953315920 None] Created volume successfully.
Sep 22 23:32:22 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] Acquiring lock "cinder-7b2558b1-bdcf-4e66-8f00-34c94eeec437-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] Lock "cinder-7b2558b1-bdcf-4e66-8f00-34c94eeec437-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:23 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Flow 'volume_create_manager' (360eab11-4938-4c22-ae4c-18788de9e598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bdf41f5-296b-46f9-9a32-3ce048dde060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bdf41f5-296b-46f9-9a32-3ce048dde060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-334333850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ae4e84-21ff-4621-aaa6-d25acee961b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0835dfd136484fa4c6cc9be30f28a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:32:23Z,use_quota=True,user_id='5c319f819410453abdc9a6afc334927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32fea656-8900-411d-900b-2317ae220884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32fea656-8900-411d-900b-2317ae220884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da73d805-0fb7-43cf-9a2a-ea2f2ed9b213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da73d805-0fb7-43cf-9a2a-ea2f2ed9b213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8ae4e84-21ff-4621-aaa6-d25acee961b9', 'volume_name': 'volume-e8ae4e84-21ff-4621-aaa6-d25acee961b9', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e4da12-7efa-4ff3-9a8f-bb0e45619753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e4da12-7efa-4ff3-9a8f-bb0e45619753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629907f0-70d4-4dd0-8fa3-eff85a8291e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:23 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Volume e8ae4e84-21ff-4621-aaa6-d25acee961b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8ae4e84-21ff-4621-aaa6-d25acee961b9', 'volume_size': 1}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-334333850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ae4e84-21ff-4621-aaa6-d25acee961b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0835dfd136484fa4c6cc9be30f28a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:32:23Z,use_quota=True,user_id='5c319f819410453abdc9a6afc334927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Creating volume e8ae4e84-21ff-4621-aaa6-d25acee961b9 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:32:23 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e8ae4e84-21ff-4621-aaa6-d25acee961b9 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:23 devstack quobyte-client[84065]: System call of process 96615 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:23 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=81, name=volume-e8ae4e84-21ff-4621-aaa6-d25acee961b9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:32:23 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] Acquiring lock "cinder-quobyte-7b2558b1-bdcf-4e66-8f00-34c94eeec437" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] Lock "cinder-quobyte-7b2558b1-bdcf-4e66-8f00-34c94eeec437" acquired by "delete_volume" :: waited 0.065s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e8ae4e84-21ff-4621-aaa6-d25acee961b9 1073741824" returned: 0 in 0.505s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e8ae4e84-21ff-4621-aaa6-d25acee961b9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[449022da-cb01-4169-92ec-93eeccc95bb1]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:32:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e8ae4e84-21ff-4621-aaa6-d25acee961b9" returned: 0 in 0.192s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:24 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] <== create_volume: return (755ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:32:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629907f0-70d4-4dd0-8fa3-eff85a8291e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8ae4e84-21ff-4621-aaa6-d25acee961b9', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20ca08d-b105-481d-b022-64bc85dac853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:24 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Volume volume-e8ae4e84-21ff-4621-aaa6-d25acee961b9 (e8ae4e84-21ff-4621-aaa6-d25acee961b9): created successfully
Sep 22 23:32:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20ca08d-b105-481d-b022-64bc85dac853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Flow 'volume_create_manager' (360eab11-4938-4c22-ae4c-18788de9e598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:32:24 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-96343b36-9094-452f-a88c-af8b81f60406 tempest-VolumesActionsTest-1516758871 None] Created volume successfully.
Sep 22 23:32:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437" returned: 0 in 0.645s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:24 devstack quobyte-client[84065]: System call of process 96623 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437" returned: 1 in 0.416s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:32:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b2558b1-bdcf-4e66-8f00-34c94eeec437" returned: 0 in 0.128s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:25 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] Lock "cinder-quobyte-7b2558b1-bdcf-4e66-8f00-34c94eeec437" released by "delete_volume" :: held 1.642s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:25 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] Created reservations ['28138dea-c9c5-40fe-b960-c9c1104e84dc', 'eb2987ed-5d88-41da-877e-ce1d798a7e3e', 'd863edfb-ce8b-4585-84cf-41de8f7e7088', '6717832b-6a6f-40ca-9f2c-5583116a193e'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:32:25 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-57aa8858-87c8-464a-8e49-446b38d76be5 tempest-VolumesActionsTest-1305307659 None] Acquiring lock "cinder-e8ae4e84-21ff-4621-aaa6-d25acee961b9-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:26 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-57aa8858-87c8-464a-8e49-446b38d76be5 tempest-VolumesActionsTest-1305307659 None] Lock "cinder-e8ae4e84-21ff-4621-aaa6-d25acee961b9-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:26 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-57aa8858-87c8-464a-8e49-446b38d76be5 tempest-VolumesActionsTest-1305307659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:26 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-57aa8858-87c8-464a-8e49-446b38d76be5 tempest-VolumesActionsTest-1305307659 None] Acquiring lock "cinder-quobyte-e8ae4e84-21ff-4621-aaa6-d25acee961b9" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:26 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:32:26 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:32:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-e5130b54-806e-4ce8-b1cf-308c27623096 req-11e38717-6a3d-469b-8c66-64f5a5158a5d tempest-AttachVolumeTestJSON-1520125212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-e5130b54-806e-4ce8-b1cf-308c27623096 req-11e38717-6a3d-469b-8c66-64f5a5158a5d tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.016s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.452s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:26 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-57aa8858-87c8-464a-8e49-446b38d76be5 tempest-VolumesActionsTest-1305307659 None] Lock "cinder-quobyte-e8ae4e84-21ff-4621-aaa6-d25acee961b9" acquired by "delete_volume" :: waited 0.483s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:26 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:32:26 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] Deleted volume successfully.
Sep 22 23:32:26 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5282cb-9a25-4380-9fa6-8baffafc33c2]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:32:26 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e36871-855a-401a-bb11-a688cf0cdb8e]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:32:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-e5130b54-806e-4ce8-b1cf-308c27623096 req-11e38717-6a3d-469b-8c66-64f5a5158a5d tempest-AttachVolumeTestJSON-1520125212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-082c036e-7fdb-4f4c-82a9-395ea04ffdc4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-57aa8858-87c8-464a-8e49-446b38d76be5 tempest-VolumesActionsTest-1305307659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e8ae4e84-21ff-4621-aaa6-d25acee961b9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:27 devstack quobyte-client[84065]: System call of process 96637 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:27 devstack quobyte-client[84065]: System call of process 96637 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:27 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3c71ec40-73a6-4250-8998-17e3c8d6f102 tempest-VolumeImageDependencyTests-1953315920 None] Lock "cinder-7b2558b1-bdcf-4e66-8f00-34c94eeec437-delete_volume" released by "delete_volume" :: held 4.602s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-e5130b54-806e-4ce8-b1cf-308c27623096 req-11e38717-6a3d-469b-8c66-64f5a5158a5d tempest-AttachVolumeTestJSON-1520125212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-082c036e-7fdb-4f4c-82a9-395ea04ffdc4" returned: 0 in 1.012s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-e5130b54-806e-4ce8-b1cf-308c27623096 req-11e38717-6a3d-469b-8c66-64f5a5158a5d tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.155s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:27 devstack quobyte-client[84065]: System call of process 96638 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-57aa8858-87c8-464a-8e49-446b38d76be5 tempest-VolumesActionsTest-1305307659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e8ae4e84-21ff-4621-aaa6-d25acee961b9" returned: 0 in 0.769s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-57aa8858-87c8-464a-8e49-446b38d76be5 tempest-VolumesActionsTest-1305307659 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e8ae4e84-21ff-4621-aaa6-d25acee961b9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:28 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-e5130b54-806e-4ce8-b1cf-308c27623096 req-11e38717-6a3d-469b-8c66-64f5a5158a5d tempest-AttachVolumeTestJSON-1520125212 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-082c036e-7fdb-4f4c-82a9-395ea04ffdc4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a2f3525-8172-4c49-9aba-6c33e47b02e8', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:32:28 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-e5130b54-806e-4ce8-b1cf-308c27623096 req-11e38717-6a3d-469b-8c66-64f5a5158a5d tempest-AttachVolumeTestJSON-1520125212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-57aa8858-87c8-464a-8e49-446b38d76be5 tempest-VolumesActionsTest-1305307659 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e8ae4e84-21ff-4621-aaa6-d25acee961b9" returned: 0 in 0.345s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:28 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-57aa8858-87c8-464a-8e49-446b38d76be5 tempest-VolumesActionsTest-1305307659 None] Lock "cinder-quobyte-e8ae4e84-21ff-4621-aaa6-d25acee961b9" released by "delete_volume" :: held 1.901s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:28 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-e5130b54-806e-4ce8-b1cf-308c27623096 req-11e38717-6a3d-469b-8c66-64f5a5158a5d tempest-AttachVolumeTestJSON-1520125212 None] attachment_update completed successfully.
Sep 22 23:32:28 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-57aa8858-87c8-464a-8e49-446b38d76be5 tempest-VolumesActionsTest-1305307659 None] Created reservations ['d9a4fde6-b473-4158-96f2-02e6ffbe0053', '02b89a06-5ff0-42ff-8f24-89c0ea21d4bf', 'c2a8d3ff-f345-46a6-b5f4-5ed392bcd121', 'c4235c16-1e54-4d6a-a84d-9304367b868f'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:32:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-57aa8858-87c8-464a-8e49-446b38d76be5 tempest-VolumesActionsTest-1305307659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-57aa8858-87c8-464a-8e49-446b38d76be5 tempest-VolumesActionsTest-1305307659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:28 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-57aa8858-87c8-464a-8e49-446b38d76be5 tempest-VolumesActionsTest-1305307659 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:32:28 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-57aa8858-87c8-464a-8e49-446b38d76be5 tempest-VolumesActionsTest-1305307659 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:32:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-57aa8858-87c8-464a-8e49-446b38d76be5 tempest-VolumesActionsTest-1305307659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-57aa8858-87c8-464a-8e49-446b38d76be5 tempest-VolumesActionsTest-1305307659 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-57aa8858-87c8-464a-8e49-446b38d76be5 tempest-VolumesActionsTest-1305307659 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.116s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:29 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-57aa8858-87c8-464a-8e49-446b38d76be5 tempest-VolumesActionsTest-1305307659 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:32:29 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-57aa8858-87c8-464a-8e49-446b38d76be5 tempest-VolumesActionsTest-1305307659 None] Deleted volume successfully.
Sep 22 23:32:29 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-57aa8858-87c8-464a-8e49-446b38d76be5 tempest-VolumesActionsTest-1305307659 None] Lock "cinder-e8ae4e84-21ff-4621-aaa6-d25acee961b9-delete_volume" released by "delete_volume" :: held 3.344s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:30 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Flow 'volume_create_manager' (6fc42f14-0914-4c5c-b28b-e5e013c1e609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034ee3dc-1af0-418d-8029-64e019ad4b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034ee3dc-1af0-418d-8029-64e019ad4b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-980298571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddafd6f4-7f9e-463f-b8c7-95896117fad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0835dfd136484fa4c6cc9be30f28a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:32:30Z,use_quota=True,user_id='5c319f819410453abdc9a6afc334927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a1d199-4de6-431b-bd01-fe45073cc561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a1d199-4de6-431b-bd01-fe45073cc561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec48c48a-3f1a-4726-a661-60afedc95846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec48c48a-3f1a-4726-a661-60afedc95846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddafd6f4-7f9e-463f-b8c7-95896117fad1', 'volume_name': 'volume-ddafd6f4-7f9e-463f-b8c7-95896117fad1', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72708fb-3b51-4269-96dc-2f57115b53a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72708fb-3b51-4269-96dc-2f57115b53a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e63e5cf-fb16-48d9-8bb7-c51894dc1748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:30 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Volume ddafd6f4-7f9e-463f-b8c7-95896117fad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddafd6f4-7f9e-463f-b8c7-95896117fad1', 'volume_size': 1}
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-980298571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddafd6f4-7f9e-463f-b8c7-95896117fad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0835dfd136484fa4c6cc9be30f28a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:32:30Z,use_quota=True,user_id='5c319f819410453abdc9a6afc334927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Creating volume ddafd6f4-7f9e-463f-b8c7-95896117fad1 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:32:30 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:32:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ddafd6f4-7f9e-463f-b8c7-95896117fad1 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:30 devstack quobyte-client[84065]: System call of process 96713 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:30 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=82, name=volume-ddafd6f4-7f9e-463f-b8c7-95896117fad1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:32:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ddafd6f4-7f9e-463f-b8c7-95896117fad1 1073741824" returned: 0 in 0.567s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ddafd6f4-7f9e-463f-b8c7-95896117fad1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ddafd6f4-7f9e-463f-b8c7-95896117fad1" returned: 0 in 0.124s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:31 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] <== create_volume: return (796ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:32:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:31 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e63e5cf-fb16-48d9-8bb7-c51894dc1748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddafd6f4-7f9e-463f-b8c7-95896117fad1', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:31 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9b019a-7614-4dd4-b6c1-3c43f7ef945d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:31 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Volume volume-ddafd6f4-7f9e-463f-b8c7-95896117fad1 (ddafd6f4-7f9e-463f-b8c7-95896117fad1): created successfully
Sep 22 23:32:31 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9b019a-7614-4dd4-b6c1-3c43f7ef945d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:31 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Flow 'volume_create_manager' (6fc42f14-0914-4c5c-b28b-e5e013c1e609) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:32:31 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-7beaa027-e89d-4daa-8df9-5f5d84985d2e tempest-VolumesActionsTest-1516758871 None] Created volume successfully.
Sep 22 23:32:32 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:32 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:32:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Flow 'volume_create_manager' (4d2b9ee2-1a48-43e4-b682-1fd903947975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c1fd44-e03d-4286-a513-7a1590d21053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-f48b2a49-ef87-4f59-ae1a-6abcf7a80c26 tempest-VolumesActionsTest-1305307659 None] Acquiring lock "cinder-ddafd6f4-7f9e-463f-b8c7-95896117fad1-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c1fd44-e03d-4286-a513-7a1590d21053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09a8fdbcabf4e2d8a545d75990aaae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:32:33Z,use_quota=True,user_id='2a8d075347a54bf39c3397bf02fbf8ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712c68c1-cb7f-45b4-936c-2ef878c67086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712c68c1-cb7f-45b4-936c-2ef878c67086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488e1688-ba0d-4bcc-a4ac-80857cd3d79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488e1688-ba0d-4bcc-a4ac-80857cd3d79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d', 'volume_name': 'volume-c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e0a1f1-c6e7-4c8c-b149-f1a80f4fd6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e0a1f1-c6e7-4c8c-b149-f1a80f4fd6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca4329f-c406-4178-a36e-6786dee8d6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:33 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Volume c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d', 'volume_size': 1}
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09a8fdbcabf4e2d8a545d75990aaae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:32:33Z,use_quota=True,user_id='2a8d075347a54bf39c3397bf02fbf8ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Creating volume c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:32:33 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:33 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-f48b2a49-ef87-4f59-ae1a-6abcf7a80c26 tempest-VolumesActionsTest-1305307659 None] Lock "cinder-ddafd6f4-7f9e-463f-b8c7-95896117fad1-delete_volume" acquired by "delete_volume" :: waited 0.366s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:33 devstack quobyte-client[84065]: System call of process 97040 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:33 devstack quobyte-client[84065]: System call of process 97040 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:33 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=83, name=volume-c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:32:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d 1073741824" returned: 0 in 0.787s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:34 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-f48b2a49-ef87-4f59-ae1a-6abcf7a80c26 tempest-VolumesActionsTest-1305307659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:34 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-f48b2a49-ef87-4f59-ae1a-6abcf7a80c26 tempest-VolumesActionsTest-1305307659 None] Acquiring lock "cinder-quobyte-ddafd6f4-7f9e-463f-b8c7-95896117fad1" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d" returned: 0 in 0.437s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:34 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] <== create_volume: return (1288ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:32:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:34 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-f48b2a49-ef87-4f59-ae1a-6abcf7a80c26 tempest-VolumesActionsTest-1305307659 None] Lock "cinder-quobyte-ddafd6f4-7f9e-463f-b8c7-95896117fad1" acquired by "delete_volume" :: waited 0.173s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca4329f-c406-4178-a36e-6786dee8d6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e4b7b5-5749-42fc-b7b1-7e0d44249a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:34 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[230765cc-b73d-4db2-ae11-8679c8a821e8]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:32:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f48b2a49-ef87-4f59-ae1a-6abcf7a80c26 tempest-VolumesActionsTest-1305307659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ddafd6f4-7f9e-463f-b8c7-95896117fad1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:35 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Volume volume-c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d (c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d): created successfully
Sep 22 23:32:35 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e4b7b5-5749-42fc-b7b1-7e0d44249a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:35 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Flow 'volume_create_manager' (4d2b9ee2-1a48-43e4-b682-1fd903947975) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:32:35 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-b58a24b0-4581-4ad8-8f4d-fbab11962232 tempest-CinderUnicodeTest-520701435 None] Created volume successfully.
Sep 22 23:32:35 devstack quobyte-client[84065]: System call of process 97047 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f48b2a49-ef87-4f59-ae1a-6abcf7a80c26 tempest-VolumesActionsTest-1305307659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ddafd6f4-7f9e-463f-b8c7-95896117fad1" returned: 0 in 0.790s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f48b2a49-ef87-4f59-ae1a-6abcf7a80c26 tempest-VolumesActionsTest-1305307659 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ddafd6f4-7f9e-463f-b8c7-95896117fad1 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f48b2a49-ef87-4f59-ae1a-6abcf7a80c26 tempest-VolumesActionsTest-1305307659 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ddafd6f4-7f9e-463f-b8c7-95896117fad1" returned: 0 in 0.143s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:35 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-f48b2a49-ef87-4f59-ae1a-6abcf7a80c26 tempest-VolumesActionsTest-1305307659 None] Lock "cinder-quobyte-ddafd6f4-7f9e-463f-b8c7-95896117fad1" released by "delete_volume" :: held 1.251s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:36 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-f48b2a49-ef87-4f59-ae1a-6abcf7a80c26 tempest-VolumesActionsTest-1305307659 None] Created reservations ['a22a21f4-c1ab-4e16-b669-ae2f977195c0', '5a92ddfc-158f-40e5-a867-cd3103ea6603', 'c669d90f-7b43-46ea-8840-a5711121e863', '32ae9f3e-ae3f-455a-af49-1ab4b26451ce'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:32:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f48b2a49-ef87-4f59-ae1a-6abcf7a80c26 tempest-VolumesActionsTest-1305307659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f48b2a49-ef87-4f59-ae1a-6abcf7a80c26 tempest-VolumesActionsTest-1305307659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f48b2a49-ef87-4f59-ae1a-6abcf7a80c26 tempest-VolumesActionsTest-1305307659 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:32:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f48b2a49-ef87-4f59-ae1a-6abcf7a80c26 tempest-VolumesActionsTest-1305307659 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:32:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f48b2a49-ef87-4f59-ae1a-6abcf7a80c26 tempest-VolumesActionsTest-1305307659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f48b2a49-ef87-4f59-ae1a-6abcf7a80c26 tempest-VolumesActionsTest-1305307659 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f48b2a49-ef87-4f59-ae1a-6abcf7a80c26 tempest-VolumesActionsTest-1305307659 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.612s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-f48b2a49-ef87-4f59-ae1a-6abcf7a80c26 tempest-VolumesActionsTest-1305307659 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:32:37 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-f48b2a49-ef87-4f59-ae1a-6abcf7a80c26 tempest-VolumesActionsTest-1305307659 None] Deleted volume successfully.
Sep 22 23:32:37 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Flow 'volume_create_manager' (00cbef21-0271-45f9-9d62-0b805da32649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d9ab4b-b71d-4c05-84aa-054ccc8747a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-f48b2a49-ef87-4f59-ae1a-6abcf7a80c26 tempest-VolumesActionsTest-1305307659 None] Lock "cinder-ddafd6f4-7f9e-463f-b8c7-95896117fad1-delete_volume" released by "delete_volume" :: held 4.308s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d9ab4b-b71d-4c05-84aa-054ccc8747a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:32:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1013482990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18bde5d4-d8b5-451a-920d-d875cc558f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09a8fdbcabf4e2d8a545d75990aaae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:32:37Z,use_quota=True,user_id='2a8d075347a54bf39c3397bf02fbf8ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74e2aa2-91f9-42f2-890e-25c0cb51af86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74e2aa2-91f9-42f2-890e-25c0cb51af86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8e580b-c3a8-41c6-bbdb-add6732c15ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8e580b-c3a8-41c6-bbdb-add6732c15ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18bde5d4-d8b5-451a-920d-d875cc558f2f', 'volume_name': 'volume-18bde5d4-d8b5-451a-920d-d875cc558f2f', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57de224-3cec-4238-8ac4-2c9ac7d1237b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57de224-3cec-4238-8ac4-2c9ac7d1237b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb94f033-39ca-4a30-8e99-1ae472d71b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:37 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Volume 18bde5d4-d8b5-451a-920d-d875cc558f2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18bde5d4-d8b5-451a-920d-d875cc558f2f', 'volume_size': 1}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:32:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1013482990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18bde5d4-d8b5-451a-920d-d875cc558f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09a8fdbcabf4e2d8a545d75990aaae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:32:37Z,use_quota=True,user_id='2a8d075347a54bf39c3397bf02fbf8ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Creating volume 18bde5d4-d8b5-451a-920d-d875cc558f2f {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:32:37 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:32:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:38 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=84, name=volume-18bde5d4-d8b5-451a-920d-d875cc558f2f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:32:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f 1073741824" returned: 0 in 0.932s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:39 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Flow 'volume_create_manager' (b87b7a04-8497-4070-8aa7-95666c7487fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a954bef-e394-476d-b740-a9a8c7cc50b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a954bef-e394-476d-b740-a9a8c7cc50b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-17562958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2a65cf8-3e7d-499c-803a-14902c520285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0835dfd136484fa4c6cc9be30f28a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:32:38Z,use_quota=True,user_id='5c319f819410453abdc9a6afc334927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (940a181d-daf5-4053-bb6a-12eb5518ecc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (940a181d-daf5-4053-bb6a-12eb5518ecc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a6fe10-22f3-4fc9-8113-25e4fbdf3b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a6fe10-22f3-4fc9-8113-25e4fbdf3b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2a65cf8-3e7d-499c-803a-14902c520285', 'volume_name': 'volume-a2a65cf8-3e7d-499c-803a-14902c520285', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d2bd57-add0-4dd7-b4f1-7bf786f0640a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d2bd57-add0-4dd7-b4f1-7bf786f0640a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fea0e5c-985e-4c89-8cee-003e5759fbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:39 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Volume a2a65cf8-3e7d-499c-803a-14902c520285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2a65cf8-3e7d-499c-803a-14902c520285', 'volume_size': 1}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f" returned: 0 in 0.639s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] <== create_volume: return (1626ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.038s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-17562958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2a65cf8-3e7d-499c-803a-14902c520285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0835dfd136484fa4c6cc9be30f28a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:32:38Z,use_quota=True,user_id='5c319f819410453abdc9a6afc334927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Creating volume a2a65cf8-3e7d-499c-803a-14902c520285 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:32:39 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a2a65cf8-3e7d-499c-803a-14902c520285 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:39 devstack quobyte-client[84065]: System call of process 97089 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:39 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=85, name=volume-a2a65cf8-3e7d-499c-803a-14902c520285, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:32:39 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Flow 'volume_create_manager' (7c59bece-f556-4da9-88f1-9fdd50226780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:32:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a18321-2857-4ade-9c56-000152e217e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb94f033-39ca-4a30-8e99-1ae472d71b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18bde5d4-d8b5-451a-920d-d875cc558f2f', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb14da8-9c4c-4792-b537-a3244cb3434e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a18321-2857-4ade-9c56-000152e217e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1481159064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e71f94c-c4c4-460a-85b5-9f8abf428406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d292b4ecb74117b122728be5976e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:32:39Z,use_quota=True,user_id='9d89dd62c2ef43daa5145ce3cddd10a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b81256-75a2-4f4e-afe3-20b11842f601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b81256-75a2-4f4e-afe3-20b11842f601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ef9997-054a-4281-8a5c-955ba219c572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ef9997-054a-4281-8a5c-955ba219c572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e71f94c-c4c4-460a-85b5-9f8abf428406', 'volume_name': 'volume-6e71f94c-c4c4-460a-85b5-9f8abf428406', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c141b233-dd1c-46da-909c-e4dfd21b08e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c141b233-dd1c-46da-909c-e4dfd21b08e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd7a21f-e185-48bd-ba71-b5f754588f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:40 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Volume 6e71f94c-c4c4-460a-85b5-9f8abf428406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e71f94c-c4c4-460a-85b5-9f8abf428406', 'volume_size': 1}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a2a65cf8-3e7d-499c-803a-14902c520285 1073741824" returned: 0 in 0.624s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a2a65cf8-3e7d-499c-803a-14902c520285 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:40 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Volume volume-18bde5d4-d8b5-451a-920d-d875cc558f2f (18bde5d4-d8b5-451a-920d-d875cc558f2f): created successfully
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb14da8-9c4c-4792-b537-a3244cb3434e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Flow 'volume_create_manager' (00cbef21-0271-45f9-9d62-0b805da32649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a2a65cf8-3e7d-499c-803a-14902c520285" returned: 0 in 0.305s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] <== create_volume: return (960ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.347s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1481159064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e71f94c-c4c4-460a-85b5-9f8abf428406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d292b4ecb74117b122728be5976e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:32:39Z,use_quota=True,user_id='9d89dd62c2ef43daa5145ce3cddd10a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Creating volume 6e71f94c-c4c4-460a-85b5-9f8abf428406 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:32:40 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:32:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6e71f94c-c4c4-460a-85b5-9f8abf428406 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:40 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=86, name=volume-6e71f94c-c4c4-460a-85b5-9f8abf428406, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:32:40 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-8ce08b09-2a13-4887-8332-cd2fef5e1887 tempest-CinderUnicodeTest-520701435 None] Created volume successfully.
Sep 22 23:32:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fea0e5c-985e-4c89-8cee-003e5759fbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2a65cf8-3e7d-499c-803a-14902c520285', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ec8556-2bb8-4498-a8ac-0f850aacc44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:41 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Volume volume-a2a65cf8-3e7d-499c-803a-14902c520285 (a2a65cf8-3e7d-499c-803a-14902c520285): created successfully
Sep 22 23:32:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ec8556-2bb8-4498-a8ac-0f850aacc44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Flow 'volume_create_manager' (b87b7a04-8497-4070-8aa7-95666c7487fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:32:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6e71f94c-c4c4-460a-85b5-9f8abf428406 1073741824" returned: 0 in 0.604s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6e71f94c-c4c4-460a-85b5-9f8abf428406 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:41 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-36c2600a-a1e3-4c8d-b7ae-f85fc08769dc tempest-VolumesActionsTest-1516758871 None] Created volume successfully.
Sep 22 23:32:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6e71f94c-c4c4-460a-85b5-9f8abf428406" returned: 0 in 0.282s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:41 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] <== create_volume: return (915ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:32:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd7a21f-e185-48bd-ba71-b5f754588f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e71f94c-c4c4-460a-85b5-9f8abf428406', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d333fe67-2744-412e-94a1-03dee91f2015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:41 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Volume volume-6e71f94c-c4c4-460a-85b5-9f8abf428406 (6e71f94c-c4c4-460a-85b5-9f8abf428406): created successfully
Sep 22 23:32:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d333fe67-2744-412e-94a1-03dee91f2015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Flow 'volume_create_manager' (7c59bece-f556-4da9-88f1-9fdd50226780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:32:41 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-f6c732cd-2c43-4e85-8b35-120c963716a1 tempest-AttachVolumeTestJSON-1520125212 None] Created volume successfully.
Sep 22 23:32:41 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:41 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] Creating offline snapshot 4ed3f8f1-14a9-4cff-9c6f-b6a131674727 of volume 18bde5d4-d8b5-451a-920d-d875cc558f2f {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:32:41 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f3f8e3-62ac-478a-925b-eef1337da115]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:32:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f" returned: 0 in 0.479s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.4ed3f8f1-14a9-4cff-9c6f-b6a131674727 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:42 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-414bfee2-ad20-49f3-806c-beb939af986b tempest-VolumesActionsTest-1305307659 None] Acquiring lock "cinder-a2a65cf8-3e7d-499c-803a-14902c520285-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:42 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=87, name=volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.4ed3f8f1-14a9-4cff-9c6f-b6a131674727, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:32:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.4ed3f8f1-14a9-4cff-9c6f-b6a131674727 1G" returned: 0 in 0.447s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] Running cmd (subprocess): qemu-img rebase -u -b volume-18bde5d4-d8b5-451a-920d-d875cc558f2f -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.4ed3f8f1-14a9-4cff-9c6f-b6a131674727 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:43 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-414bfee2-ad20-49f3-806c-beb939af986b tempest-VolumesActionsTest-1305307659 None] Lock "cinder-a2a65cf8-3e7d-499c-803a-14902c520285-delete_volume" acquired by "delete_volume" :: waited 0.310s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:43 devstack quobyte-client[84065]: System call of process 97103 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:43 devstack quobyte-client[84065]: System call of process 97103 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:43 devstack quobyte-client[84065]: System call of process 97103 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] CMD "qemu-img rebase -u -b volume-18bde5d4-d8b5-451a-920d-d875cc558f2f -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.4ed3f8f1-14a9-4cff-9c6f-b6a131674727" returned: 0 in 0.301s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.4ed3f8f1-14a9-4cff-9c6f-b6a131674727 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:32:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.4ed3f8f1-14a9-4cff-9c6f-b6a131674727 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.4ed3f8f1-14a9-4cff-9c6f-b6a131674727" returned: 0 in 0.292s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:32:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.4ed3f8f1-14a9-4cff-9c6f-b6a131674727 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:43 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-414bfee2-ad20-49f3-806c-beb939af986b tempest-VolumesActionsTest-1305307659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:43 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-414bfee2-ad20-49f3-806c-beb939af986b tempest-VolumesActionsTest-1305307659 None] Acquiring lock "cinder-quobyte-a2a65cf8-3e7d-499c-803a-14902c520285" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.4ed3f8f1-14a9-4cff-9c6f-b6a131674727" returned: 0 in 0.434s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:44 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-414bfee2-ad20-49f3-806c-beb939af986b tempest-VolumesActionsTest-1305307659 None] Lock "cinder-quobyte-a2a65cf8-3e7d-499c-803a-14902c520285" acquired by "delete_volume" :: waited 0.194s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:44 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f0ffc1-5e29-4ce8-b186-54c192e42adf]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:32:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-414bfee2-ad20-49f3-806c-beb939af986b tempest-VolumesActionsTest-1305307659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a2a65cf8-3e7d-499c-803a-14902c520285 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.info" returned: 0 in 0.299s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:44 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.info is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:32:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.info" returned: 0 in 0.156s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.698s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:44 devstack quobyte-client[84065]: System call of process 97123 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:44 devstack quobyte-client[84065]: System call of process 97123 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:45 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-25eaf808-6c20-4e84-9360-d53b055c1c0c tempest-CinderUnicodeTest-520701435 None] Create snapshot completed successfully
Sep 22 23:32:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-414bfee2-ad20-49f3-806c-beb939af986b tempest-VolumesActionsTest-1305307659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a2a65cf8-3e7d-499c-803a-14902c520285" returned: 0 in 0.790s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-414bfee2-ad20-49f3-806c-beb939af986b tempest-VolumesActionsTest-1305307659 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a2a65cf8-3e7d-499c-803a-14902c520285 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-414bfee2-ad20-49f3-806c-beb939af986b tempest-VolumesActionsTest-1305307659 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a2a65cf8-3e7d-499c-803a-14902c520285" returned: 0 in 0.158s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:45 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] Acquiring lock "cinder-4ed3f8f1-14a9-4cff-9c6f-b6a131674727-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:45 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-414bfee2-ad20-49f3-806c-beb939af986b tempest-VolumesActionsTest-1305307659 None] Lock "cinder-quobyte-a2a65cf8-3e7d-499c-803a-14902c520285" released by "delete_volume" :: held 1.316s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:45 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] Lock "cinder-4ed3f8f1-14a9-4cff-9c6f-b6a131674727-delete_snapshot" acquired by "delete_snapshot" :: waited 0.200s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:45 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:45 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] Acquiring lock "cinder-quobyte-18bde5d4-d8b5-451a-920d-d875cc558f2f" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:45 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] Lock "cinder-quobyte-18bde5d4-d8b5-451a-920d-d875cc558f2f" acquired by "delete_snapshot" :: waited 0.044s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:45 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] Acquiring lock "cinder-quobyte-4ed3f8f1-14a9-4cff-9c6f-b6a131674727" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:45 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] Lock "cinder-quobyte-4ed3f8f1-14a9-4cff-9c6f-b6a131674727" acquired by "_delete_snapshot" :: waited 0.076s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:45 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] Deleting offline snapshot 4ed3f8f1-14a9-4cff-9c6f-b6a131674727 of volume 18bde5d4-d8b5-451a-920d-d875cc558f2f {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:32:45 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] snapshot_file for this snap is: volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.4ed3f8f1-14a9-4cff-9c6f-b6a131674727 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:32:45 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[beda6fd2-dede-4eb9-85cb-d6eb085802eb]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:32:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.4ed3f8f1-14a9-4cff-9c6f-b6a131674727 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:46 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-414bfee2-ad20-49f3-806c-beb939af986b tempest-VolumesActionsTest-1305307659 None] Created reservations ['c0c0c8ef-df22-4f8f-9003-412c11c2a8ba', '4db6275c-d7f4-4adc-86d7-8e04ac85a4af', 'ee9600c4-f518-4f81-b769-231f41c35be8', 'a927c4f8-9a48-4d20-81c7-40c354203b56'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:32:46 devstack quobyte-client[84065]: System call of process 97134 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.4ed3f8f1-14a9-4cff-9c6f-b6a131674727" returned: 0 in 0.808s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18bde5d4-d8b5-451a-920d-d875cc558f2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:32:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-414bfee2-ad20-49f3-806c-beb939af986b tempest-VolumesActionsTest-1305307659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-414bfee2-ad20-49f3-806c-beb939af986b tempest-VolumesActionsTest-1305307659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-414bfee2-ad20-49f3-806c-beb939af986b tempest-VolumesActionsTest-1305307659 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:32:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-414bfee2-ad20-49f3-806c-beb939af986b tempest-VolumesActionsTest-1305307659 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:32:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-414bfee2-ad20-49f3-806c-beb939af986b tempest-VolumesActionsTest-1305307659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-414bfee2-ad20-49f3-806c-beb939af986b tempest-VolumesActionsTest-1305307659 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:46 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[db88a229-20f6-4e21-bce4-99f0ddb93198]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:32:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-fd1f8468-7011-42c6-b037-19601865f4ff req-ffb16eea-13c5-4b71-9578-d0bb15a61b5e tempest-AttachVolumeTestJSON-1520125212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-fd1f8468-7011-42c6-b037-19601865f4ff req-ffb16eea-13c5-4b71-9578-d0bb15a61b5e tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-414bfee2-ad20-49f3-806c-beb939af986b tempest-VolumesActionsTest-1305307659 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.667s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:47 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-414bfee2-ad20-49f3-806c-beb939af986b tempest-VolumesActionsTest-1305307659 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:32:47 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed3217b-bce9-434d-8025-03f3b39cff8b]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:32:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-fd1f8468-7011-42c6-b037-19601865f4ff req-ffb16eea-13c5-4b71-9578-d0bb15a61b5e tempest-AttachVolumeTestJSON-1520125212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6e71f94c-c4c4-460a-85b5-9f8abf428406 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:47 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-414bfee2-ad20-49f3-806c-beb939af986b tempest-VolumesActionsTest-1305307659 None] Deleted volume successfully.
Sep 22 23:32:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:32:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:32:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:32:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:48 devstack quobyte-client[84065]: System call of process 97143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:48 devstack quobyte-client[84065]: System call of process 97143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:48 devstack quobyte-client[84065]: System call of process 97143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f" returned: 0 in 1.781s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:48 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-414bfee2-ad20-49f3-806c-beb939af986b tempest-VolumesActionsTest-1305307659 None] Lock "cinder-a2a65cf8-3e7d-499c-803a-14902c520285-delete_volume" released by "delete_volume" :: held 5.670s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.4ed3f8f1-14a9-4cff-9c6f-b6a131674727 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:48 devstack quobyte-client[84065]: System call of process 97149 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:48 devstack quobyte-client[84065]: System call of process 97149 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:48 devstack quobyte-client[84065]: System call of process 97149 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-fd1f8468-7011-42c6-b037-19601865f4ff req-ffb16eea-13c5-4b71-9578-d0bb15a61b5e tempest-AttachVolumeTestJSON-1520125212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6e71f94c-c4c4-460a-85b5-9f8abf428406" returned: 0 in 1.651s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-fd1f8468-7011-42c6-b037-19601865f4ff req-ffb16eea-13c5-4b71-9578-d0bb15a61b5e tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.838s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 1.163s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:49 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Flow 'volume_create_manager' (a8efb47a-e42f-466e-9b01-d947fdfc45de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0debc6-077c-4544-afc3-352bbb7ac6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=76,cinder:SELECT=60,cinder:INSERT=17,cinder:DELETE=5 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.4ed3f8f1-14a9-4cff-9c6f-b6a131674727" returned: 0 in 0.704s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0debc6-077c-4544-afc3-352bbb7ac6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1292771648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0835dfd136484fa4c6cc9be30f28a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:32:48Z,use_quota=True,user_id='5c319f819410453abdc9a6afc334927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4acaf5-9cc6-4c36-8b16-697614fc338e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4acaf5-9cc6-4c36-8b16-697614fc338e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27121f28-510e-46f6-86e6-64c52c0cb7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27121f28-510e-46f6-86e6-64c52c0cb7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d', 'volume_name': 'volume-b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66e17c4-53d3-46a5-b0ec-e17454b4487e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66e17c4-53d3-46a5-b0ec-e17454b4487e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb593f50-5e1f-4297-bf97-11419ecd547f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:49 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Volume b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d', 'volume_size': 1}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1292771648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0835dfd136484fa4c6cc9be30f28a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:32:48Z,use_quota=True,user_id='5c319f819410453abdc9a6afc334927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Creating volume b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:32:49 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.4ed3f8f1-14a9-4cff-9c6f-b6a131674727 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:49 devstack quobyte-client[84065]: System call of process 97152 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:49 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=89, name=volume-b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:32:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f.4ed3f8f1-14a9-4cff-9c6f-b6a131674727" returned: 0 in 0.521s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d 1073741824" returned: 0 in 0.692s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] Lock "cinder-quobyte-4ed3f8f1-14a9-4cff-9c6f-b6a131674727" released by "_delete_snapshot" :: held 4.773s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:50 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-fd1f8468-7011-42c6-b037-19601865f4ff req-ffb16eea-13c5-4b71-9578-d0bb15a61b5e tempest-AttachVolumeTestJSON-1520125212 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-6e71f94c-c4c4-460a-85b5-9f8abf428406', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7748cec6-0493-4d00-8d84-870df205f7d1', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:32:50 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-fd1f8468-7011-42c6-b037-19601865f4ff req-ffb16eea-13c5-4b71-9578-d0bb15a61b5e tempest-AttachVolumeTestJSON-1520125212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] Lock "cinder-quobyte-18bde5d4-d8b5-451a-920d-d875cc558f2f" released by "delete_snapshot" :: held 5.001s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d" returned: 0 in 0.546s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:50 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] <== create_volume: return (1278ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:32:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:50 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb593f50-5e1f-4297-bf97-11419ecd547f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:50 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315e4085-ce61-4d48-8c2a-6e3a13df46b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:51 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Volume volume-b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d (b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d): created successfully
Sep 22 23:32:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315e4085-ce61-4d48-8c2a-6e3a13df46b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Flow 'volume_create_manager' (a8efb47a-e42f-466e-9b01-d947fdfc45de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:32:51 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] Created reservations ['0eff1f16-231d-40aa-9ec0-957b58f0dbed', '9d730e99-9f23-4656-81f1-a21b7ca834e2', 'ed303691-d8dd-430f-9557-4a311188119a', '6dcda802-a418-4e86-a4db-1f70c009b242'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:32:51 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-fd1f8468-7011-42c6-b037-19601865f4ff req-ffb16eea-13c5-4b71-9578-d0bb15a61b5e tempest-AttachVolumeTestJSON-1520125212 None] attachment_update completed successfully.
Sep 22 23:32:51 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-851d1e63-7c51-4890-8c89-a5b7d798fdc4 tempest-VolumesActionsTest-1516758871 None] Created volume successfully.
Sep 22 23:32:51 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] Delete snapshot completed successfully.
Sep 22 23:32:51 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e0e140dd-0138-4839-8422-84faac49b70d tempest-CinderUnicodeTest-520701435 None] Lock "cinder-4ed3f8f1-14a9-4cff-9c6f-b6a131674727-delete_snapshot" released by "delete_snapshot" :: held 5.578s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:51 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2e64ea12-19c1-46fd-a0ac-99f99119b4cf tempest-CinderUnicodeTest-520701435 None] Acquiring lock "cinder-18bde5d4-d8b5-451a-920d-d875cc558f2f-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:51 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-05e5097d-6891-4930-a1bc-9ce281a7993a tempest-VolumesActionsTest-1305307659 None] Acquiring lock "cinder-b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-05e5097d-6891-4930-a1bc-9ce281a7993a tempest-VolumesActionsTest-1305307659 None] Lock "cinder-b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2e64ea12-19c1-46fd-a0ac-99f99119b4cf tempest-CinderUnicodeTest-520701435 None] Lock "cinder-18bde5d4-d8b5-451a-920d-d875cc558f2f-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:52 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=61,cinder:UPDATE=70,cinder:DELETE=10,cinder:INSERT=16 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:32:52 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-05e5097d-6891-4930-a1bc-9ce281a7993a tempest-VolumesActionsTest-1305307659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-05e5097d-6891-4930-a1bc-9ce281a7993a tempest-VolumesActionsTest-1305307659 None] Acquiring lock "cinder-quobyte-b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:52 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-2e64ea12-19c1-46fd-a0ac-99f99119b4cf tempest-CinderUnicodeTest-520701435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2e64ea12-19c1-46fd-a0ac-99f99119b4cf tempest-CinderUnicodeTest-520701435 None] Acquiring lock "cinder-quobyte-18bde5d4-d8b5-451a-920d-d875cc558f2f" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-05e5097d-6891-4930-a1bc-9ce281a7993a tempest-VolumesActionsTest-1305307659 None] Lock "cinder-quobyte-b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d" acquired by "delete_volume" :: waited 0.019s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2e64ea12-19c1-46fd-a0ac-99f99119b4cf tempest-CinderUnicodeTest-520701435 None] Lock "cinder-quobyte-18bde5d4-d8b5-451a-920d-d875cc558f2f" acquired by "delete_volume" :: waited 0.050s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:52 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[db318fb8-6222-43ca-acd4-bcbdfe78b35e]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:32:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-05e5097d-6891-4930-a1bc-9ce281a7993a tempest-VolumesActionsTest-1305307659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:52 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda1b8b1-3736-4ecf-bc28-05d82610777d]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:32:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2e64ea12-19c1-46fd-a0ac-99f99119b4cf tempest-CinderUnicodeTest-520701435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:52 devstack quobyte-client[84065]: System call of process 97186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-05e5097d-6891-4930-a1bc-9ce281a7993a tempest-VolumesActionsTest-1305307659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d" returned: 0 in 0.600s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-05e5097d-6891-4930-a1bc-9ce281a7993a tempest-VolumesActionsTest-1305307659 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:52 devstack quobyte-client[84065]: System call of process 97187 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-05e5097d-6891-4930-a1bc-9ce281a7993a tempest-VolumesActionsTest-1305307659 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d" returned: 0 in 0.228s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2e64ea12-19c1-46fd-a0ac-99f99119b4cf tempest-CinderUnicodeTest-520701435 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f" returned: 0 in 0.918s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:53 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-05e5097d-6891-4930-a1bc-9ce281a7993a tempest-VolumesActionsTest-1305307659 None] Lock "cinder-quobyte-b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d" released by "delete_volume" :: held 1.154s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2e64ea12-19c1-46fd-a0ac-99f99119b4cf tempest-CinderUnicodeTest-520701435 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2e64ea12-19c1-46fd-a0ac-99f99119b4cf tempest-CinderUnicodeTest-520701435 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-18bde5d4-d8b5-451a-920d-d875cc558f2f" returned: 0 in 0.291s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:53 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2e64ea12-19c1-46fd-a0ac-99f99119b4cf tempest-CinderUnicodeTest-520701435 None] Lock "cinder-quobyte-18bde5d4-d8b5-451a-920d-d875cc558f2f" released by "delete_volume" :: held 1.601s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:53 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-05e5097d-6891-4930-a1bc-9ce281a7993a tempest-VolumesActionsTest-1305307659 None] Created reservations ['b78e46ba-416d-484f-8a93-8ba0037e52c0', '54c6ab65-9f70-476f-a35f-10e56c72fad6', 'b17729a7-7508-4c26-bf6e-ff05973264df', '95dd12e9-24ab-4a18-88da-0aaa6e45f257'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:32:53 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-2e64ea12-19c1-46fd-a0ac-99f99119b4cf tempest-CinderUnicodeTest-520701435 None] Created reservations ['43661789-82ea-4698-a0a4-b05a8000350c', '51ece5d3-7056-4ccb-b803-033ad74e0c21', '92742be0-fe5c-4cd8-8b63-bfad51ae42f7', '77af6ef0-c0f0-4b4a-b869-63a58b88906b'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:32:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-05e5097d-6891-4930-a1bc-9ce281a7993a tempest-VolumesActionsTest-1305307659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-05e5097d-6891-4930-a1bc-9ce281a7993a tempest-VolumesActionsTest-1305307659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-05e5097d-6891-4930-a1bc-9ce281a7993a tempest-VolumesActionsTest-1305307659 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:32:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-05e5097d-6891-4930-a1bc-9ce281a7993a tempest-VolumesActionsTest-1305307659 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:32:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-05e5097d-6891-4930-a1bc-9ce281a7993a tempest-VolumesActionsTest-1305307659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-05e5097d-6891-4930-a1bc-9ce281a7993a tempest-VolumesActionsTest-1305307659 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-05e5097d-6891-4930-a1bc-9ce281a7993a tempest-VolumesActionsTest-1305307659 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.216s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:54 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-05e5097d-6891-4930-a1bc-9ce281a7993a tempest-VolumesActionsTest-1305307659 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:32:54 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-05e5097d-6891-4930-a1bc-9ce281a7993a tempest-VolumesActionsTest-1305307659 None] Deleted volume successfully.
Sep 22 23:32:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2e64ea12-19c1-46fd-a0ac-99f99119b4cf tempest-CinderUnicodeTest-520701435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2e64ea12-19c1-46fd-a0ac-99f99119b4cf tempest-CinderUnicodeTest-520701435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-2e64ea12-19c1-46fd-a0ac-99f99119b4cf tempest-CinderUnicodeTest-520701435 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:32:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-2e64ea12-19c1-46fd-a0ac-99f99119b4cf tempest-CinderUnicodeTest-520701435 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:32:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2e64ea12-19c1-46fd-a0ac-99f99119b4cf tempest-CinderUnicodeTest-520701435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2e64ea12-19c1-46fd-a0ac-99f99119b4cf tempest-CinderUnicodeTest-520701435 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2d7dff96-8fe1-4347-bc3c-762453466182 tempest-CinderUnicodeTest-520701435 None] Acquiring lock "cinder-c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-05e5097d-6891-4930-a1bc-9ce281a7993a tempest-VolumesActionsTest-1305307659 None] Lock "cinder-b9e40456-3f9c-42bc-9b08-c2ee87a5cc2d-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2e64ea12-19c1-46fd-a0ac-99f99119b4cf tempest-CinderUnicodeTest-520701435 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.461s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:54 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-2e64ea12-19c1-46fd-a0ac-99f99119b4cf tempest-CinderUnicodeTest-520701435 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2d7dff96-8fe1-4347-bc3c-762453466182 tempest-CinderUnicodeTest-520701435 None] Lock "cinder-c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d-delete_volume" acquired by "delete_volume" :: waited 0.168s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:55 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-2e64ea12-19c1-46fd-a0ac-99f99119b4cf tempest-CinderUnicodeTest-520701435 None] Deleted volume successfully.
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2e64ea12-19c1-46fd-a0ac-99f99119b4cf tempest-CinderUnicodeTest-520701435 None] Lock "cinder-18bde5d4-d8b5-451a-920d-d875cc558f2f-delete_volume" released by "delete_volume" :: held 3.206s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:55 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-2d7dff96-8fe1-4347-bc3c-762453466182 tempest-CinderUnicodeTest-520701435 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2d7dff96-8fe1-4347-bc3c-762453466182 tempest-CinderUnicodeTest-520701435 None] Acquiring lock "cinder-quobyte-c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2d7dff96-8fe1-4347-bc3c-762453466182 tempest-CinderUnicodeTest-520701435 None] Lock "cinder-quobyte-c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d" acquired by "delete_volume" :: waited 0.033s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:55 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Flow 'volume_create_manager' (7c25117f-76f5-4f75-a008-181887f819a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab06964-2d6f-4a82-857a-737f451fb688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb17c607-4228-4772-bcdb-b4f8d4dbcab7]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2d7dff96-8fe1-4347-bc3c-762453466182 tempest-CinderUnicodeTest-520701435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab06964-2d6f-4a82-857a-737f451fb688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-753700915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb20d001-d2d8-43a3-b9d9-11adcc2c5291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0835dfd136484fa4c6cc9be30f28a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:32:55Z,use_quota=True,user_id='5c319f819410453abdc9a6afc334927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a036a8e-5712-4e45-8766-98ee99394173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a036a8e-5712-4e45-8766-98ee99394173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d99657-c7f7-4b6d-8521-c09af28acff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d99657-c7f7-4b6d-8521-c09af28acff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb20d001-d2d8-43a3-b9d9-11adcc2c5291', 'volume_name': 'volume-eb20d001-d2d8-43a3-b9d9-11adcc2c5291', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644fff95-cfe0-4f3f-8598-6009d21dc068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644fff95-cfe0-4f3f-8598-6009d21dc068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d809c1-f713-4747-80cf-39db9d6caa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:55 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Volume eb20d001-d2d8-43a3-b9d9-11adcc2c5291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb20d001-d2d8-43a3-b9d9-11adcc2c5291', 'volume_size': 1}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-753700915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb20d001-d2d8-43a3-b9d9-11adcc2c5291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0835dfd136484fa4c6cc9be30f28a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:32:55Z,use_quota=True,user_id='5c319f819410453abdc9a6afc334927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Creating volume eb20d001-d2d8-43a3-b9d9-11adcc2c5291 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:32:55 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:32:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-eb20d001-d2d8-43a3-b9d9-11adcc2c5291 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:55 devstack quobyte-client[84065]: System call of process 97198 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:56 devstack quobyte-client[84065]: System call of process 97199 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:56 devstack quobyte-client[84065]: System call of process 97199 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:56 devstack quobyte-client[84065]: System call of process 97199 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:56 devstack quobyte-client[84065]: System call of process 97199 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:56 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=90, name=volume-eb20d001-d2d8-43a3-b9d9-11adcc2c5291, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:32:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2d7dff96-8fe1-4347-bc3c-762453466182 tempest-CinderUnicodeTest-520701435 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d" returned: 0 in 0.676s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2d7dff96-8fe1-4347-bc3c-762453466182 tempest-CinderUnicodeTest-520701435 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2d7dff96-8fe1-4347-bc3c-762453466182 tempest-CinderUnicodeTest-520701435 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d" returned: 0 in 0.160s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-eb20d001-d2d8-43a3-b9d9-11adcc2c5291 1073741824" returned: 0 in 0.558s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-eb20d001-d2d8-43a3-b9d9-11adcc2c5291 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:56 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2d7dff96-8fe1-4347-bc3c-762453466182 tempest-CinderUnicodeTest-520701435 None] Lock "cinder-quobyte-c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d" released by "delete_volume" :: held 1.340s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-eb20d001-d2d8-43a3-b9d9-11adcc2c5291" returned: 0 in 0.494s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:56 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] <== create_volume: return (1102ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:32:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d809c1-f713-4747-80cf-39db9d6caa07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb20d001-d2d8-43a3-b9d9-11adcc2c5291', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d783139-c2fa-442b-87f1-f65252f5c545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:32:57 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Volume volume-eb20d001-d2d8-43a3-b9d9-11adcc2c5291 (eb20d001-d2d8-43a3-b9d9-11adcc2c5291): created successfully
Sep 22 23:32:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d783139-c2fa-442b-87f1-f65252f5c545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:32:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Flow 'volume_create_manager' (7c25117f-76f5-4f75-a008-181887f819a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:32:57 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-2d7dff96-8fe1-4347-bc3c-762453466182 tempest-CinderUnicodeTest-520701435 None] Created reservations ['574190d0-da15-4569-9257-2b266e26e99d', '6f562c5d-2024-48cc-b347-e599e8f36e5c', 'd0bf85ec-bec5-4153-b077-75936e94f76a', '5a6c72c8-12a6-4d54-8f1b-f9ea7c7ad0f2'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:32:57 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-c677992d-5ce4-433f-8f51-65a6f74d3df6 tempest-VolumesActionsTest-1516758871 None] Created volume successfully.
Sep 22 23:32:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2d7dff96-8fe1-4347-bc3c-762453466182 tempest-CinderUnicodeTest-520701435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:32:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2d7dff96-8fe1-4347-bc3c-762453466182 tempest-CinderUnicodeTest-520701435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:32:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-2d7dff96-8fe1-4347-bc3c-762453466182 tempest-CinderUnicodeTest-520701435 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:32:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-2d7dff96-8fe1-4347-bc3c-762453466182 tempest-CinderUnicodeTest-520701435 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:32:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2d7dff96-8fe1-4347-bc3c-762453466182 tempest-CinderUnicodeTest-520701435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:32:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2d7dff96-8fe1-4347-bc3c-762453466182 tempest-CinderUnicodeTest-520701435 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2d7dff96-8fe1-4347-bc3c-762453466182 tempest-CinderUnicodeTest-520701435 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.110s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:57 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-2d7dff96-8fe1-4347-bc3c-762453466182 tempest-CinderUnicodeTest-520701435 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:32:57 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-2d7dff96-8fe1-4347-bc3c-762453466182 tempest-CinderUnicodeTest-520701435 None] Deleted volume successfully.
Sep 22 23:32:57 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2d7dff96-8fe1-4347-bc3c-762453466182 tempest-CinderUnicodeTest-520701435 None] Lock "cinder-c3c8e3a9-806b-488a-aaa2-2ce09a0ec68d-delete_volume" released by "delete_volume" :: held 2.866s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:32:58 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0b9fcc4b-95b5-4711-ac55-db1178869520 tempest-VolumesActionsTest-1516758871 None] Acquiring lock "cinder-eb20d001-d2d8-43a3-b9d9-11adcc2c5291-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:58 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0b9fcc4b-95b5-4711-ac55-db1178869520 tempest-VolumesActionsTest-1516758871 None] Lock "cinder-eb20d001-d2d8-43a3-b9d9-11adcc2c5291-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:58 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-0b9fcc4b-95b5-4711-ac55-db1178869520 tempest-VolumesActionsTest-1516758871 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:32:58 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0b9fcc4b-95b5-4711-ac55-db1178869520 tempest-VolumesActionsTest-1516758871 None] Acquiring lock "cinder-quobyte-eb20d001-d2d8-43a3-b9d9-11adcc2c5291" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:32:59 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0b9fcc4b-95b5-4711-ac55-db1178869520 tempest-VolumesActionsTest-1516758871 None] Lock "cinder-quobyte-eb20d001-d2d8-43a3-b9d9-11adcc2c5291" acquired by "delete_volume" :: waited 0.030s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:32:59 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[084cb65b-8bd3-4fac-ae26-b649b004b71c]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:32:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0b9fcc4b-95b5-4711-ac55-db1178869520 tempest-VolumesActionsTest-1516758871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-eb20d001-d2d8-43a3-b9d9-11adcc2c5291 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:59 devstack quobyte-client[84065]: System call of process 97219 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:59 devstack quobyte-client[84065]: System call of process 97219 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:59 devstack quobyte-client[84065]: System call of process 97219 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:59 devstack quobyte-client[84065]: System call of process 97219 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:32:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0b9fcc4b-95b5-4711-ac55-db1178869520 tempest-VolumesActionsTest-1516758871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-eb20d001-d2d8-43a3-b9d9-11adcc2c5291" returned: 0 in 0.609s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:32:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0b9fcc4b-95b5-4711-ac55-db1178869520 tempest-VolumesActionsTest-1516758871 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-eb20d001-d2d8-43a3-b9d9-11adcc2c5291 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:32:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0b9fcc4b-95b5-4711-ac55-db1178869520 tempest-VolumesActionsTest-1516758871 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-eb20d001-d2d8-43a3-b9d9-11adcc2c5291" returned: 0 in 0.151s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:00 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0b9fcc4b-95b5-4711-ac55-db1178869520 tempest-VolumesActionsTest-1516758871 None] Lock "cinder-quobyte-eb20d001-d2d8-43a3-b9d9-11adcc2c5291" released by "delete_volume" :: held 1.011s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:33:00 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-0b9fcc4b-95b5-4711-ac55-db1178869520 tempest-VolumesActionsTest-1516758871 None] Created reservations ['a5d6f1b6-594f-4b29-9a16-ae1e858a27d6', 'd6e82a2f-8578-4a6d-8070-8a7fd611702b', '954201bf-d7a8-4414-96aa-492f618c92ce', '93b05f6e-ffe7-4548-9ed1-b0a83b849204'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:33:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0b9fcc4b-95b5-4711-ac55-db1178869520 tempest-VolumesActionsTest-1516758871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:33:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0b9fcc4b-95b5-4711-ac55-db1178869520 tempest-VolumesActionsTest-1516758871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:33:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0b9fcc4b-95b5-4711-ac55-db1178869520 tempest-VolumesActionsTest-1516758871 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:33:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0b9fcc4b-95b5-4711-ac55-db1178869520 tempest-VolumesActionsTest-1516758871 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:33:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0b9fcc4b-95b5-4711-ac55-db1178869520 tempest-VolumesActionsTest-1516758871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:33:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0b9fcc4b-95b5-4711-ac55-db1178869520 tempest-VolumesActionsTest-1516758871 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0b9fcc4b-95b5-4711-ac55-db1178869520 tempest-VolumesActionsTest-1516758871 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.232s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:01 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-0b9fcc4b-95b5-4711-ac55-db1178869520 tempest-VolumesActionsTest-1516758871 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:33:01 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-0b9fcc4b-95b5-4711-ac55-db1178869520 tempest-VolumesActionsTest-1516758871 None] Deleted volume successfully.
Sep 22 23:33:01 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0b9fcc4b-95b5-4711-ac55-db1178869520 tempest-VolumesActionsTest-1516758871 None] Lock "cinder-eb20d001-d2d8-43a3-b9d9-11adcc2c5291-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:33:10 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=33,cinder:UPDATE=34,cinder:INSERT=12,cinder:DELETE=4 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:33:11 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=19,cinder:INSERT=6,cinder:UPDATE=38,cinder:DELETE=2 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:33:19 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-f4ab8174-646f-45a8-ba1e-bed8d8c860ef req-7d39e375-fba8-4ccb-918f-5ac7ad1e3d6c tempest-AttachVolumeTestJSON-1520125212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:33:19 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-f4ab8174-646f-45a8-ba1e-bed8d8c860ef req-7d39e375-fba8-4ccb-918f-5ac7ad1e3d6c tempest-AttachVolumeTestJSON-1520125212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:33:19 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-f4ab8174-646f-45a8-ba1e-bed8d8c860ef req-7d39e375-fba8-4ccb-918f-5ac7ad1e3d6c tempest-AttachVolumeTestJSON-1520125212 None] Terminate volume connection completed successfully.
Sep 22 23:33:19 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-f4ab8174-646f-45a8-ba1e-bed8d8c860ef req-7d39e375-fba8-4ccb-918f-5ac7ad1e3d6c tempest-AttachVolumeTestJSON-1520125212 None] Deleting attachment 4a2f3525-8172-4c49-9aba-6c33e47b02e8. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:33:20 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Flow 'volume_create_manager' (5f012cdd-451b-4f65-887f-730f25437426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7482658e-453c-46ba-8719-e780bbed87df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7482658e-453c-46ba-8719-e780bbed87df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-614402886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800fc054-9ed8-4508-acf4-74a2bc051775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4df08240634f08a666ef4495e3cbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:33:20Z,use_quota=True,user_id='a8ba9fe621ae4fb386d2187b515e2eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6483e0ae-599a-4700-b00a-c1dc69d4c9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6483e0ae-599a-4700-b00a-c1dc69d4c9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1476a1b7-b84e-4a16-8d51-4521c8934f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1476a1b7-b84e-4a16-8d51-4521c8934f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '800fc054-9ed8-4508-acf4-74a2bc051775', 'volume_name': 'volume-800fc054-9ed8-4508-acf4-74a2bc051775', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e616fa-f50d-44db-8c2b-1bf200d2371f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e616fa-f50d-44db-8c2b-1bf200d2371f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d849b7-b6d5-4311-9cf6-38779c6ba03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:33:20 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Volume 800fc054-9ed8-4508-acf4-74a2bc051775: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-800fc054-9ed8-4508-acf4-74a2bc051775', 'volume_size': 1}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-614402886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800fc054-9ed8-4508-acf4-74a2bc051775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4df08240634f08a666ef4495e3cbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:33:20Z,use_quota=True,user_id='a8ba9fe621ae4fb386d2187b515e2eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Creating volume 800fc054-9ed8-4508-acf4-74a2bc051775 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:33:20 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:20 devstack quobyte-client[84065]: System call of process 97233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:33:20 devstack quobyte-client[84065]: System call of process 97233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:33:20 devstack quobyte-client[84065]: System call of process 97233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:33:20 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=91, name=volume-800fc054-9ed8-4508-acf4-74a2bc051775, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775 1073741824" returned: 0 in 0.463s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775" returned: 0 in 0.184s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] <== create_volume: return (743ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:33:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:33:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d849b7-b6d5-4311-9cf6-38779c6ba03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-800fc054-9ed8-4508-acf4-74a2bc051775', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:33:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9e8c39-188e-464c-a6da-692b0439b4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:33:21 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Volume volume-800fc054-9ed8-4508-acf4-74a2bc051775 (800fc054-9ed8-4508-acf4-74a2bc051775): created successfully
Sep 22 23:33:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9e8c39-188e-464c-a6da-692b0439b4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:33:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Flow 'volume_create_manager' (5f012cdd-451b-4f65-887f-730f25437426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:33:21 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-f8ef3809-1fd8-4a17-840e-79e0231d1991 tempest-VolumesDeleteCascade-433107890 None] Created volume successfully.
Sep 22 23:33:22 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:33:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:33:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:33:22 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] Creating offline snapshot f949f456-1f92-4965-b75a-3fa56090d435 of volume 800fc054-9ed8-4508-acf4-74a2bc051775 {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:33:22 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea2d98b-b0dc-4a82-9f9f-815ea10f3773]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:33:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775" returned: 0 in 0.591s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:23 devstack quobyte-client[84065]: System call of process 97243 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:33:23 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=92, name=volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:33:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435 1G" returned: 0 in 0.489s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): qemu-img rebase -u -b volume-800fc054-9ed8-4508-acf4-74a2bc051775 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:24 devstack quobyte-client[84065]: System call of process 97247 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:33:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] CMD "qemu-img rebase -u -b volume-800fc054-9ed8-4508-acf4-74a2bc051775 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435" returned: 0 in 0.149s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:24 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:33:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435" returned: 0 in 0.099s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:24 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775 -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:33:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435" returned: 0 in 0.110s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.info" returned: 0 in 0.097s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:24 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.info is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:33:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.info" returned: 0 in 0.109s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.031s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:33:25 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-4c90d5db-52a9-4150-9dfc-eae81b12fe7a tempest-VolumesDeleteCascade-433107890 None] Create snapshot completed successfully
Sep 22 23:33:26 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-2ed5853e-6c17-4406-9920-635f92941268 tempest-VolumesDeleteCascade-433107890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:33:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2ed5853e-6c17-4406-9920-635f92941268 tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:33:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2ed5853e-6c17-4406-9920-635f92941268 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:33:26 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-2ed5853e-6c17-4406-9920-635f92941268 tempest-VolumesDeleteCascade-433107890 None] Creating offline snapshot 3526b94e-cb82-4a56-b021-5367f4150ac4 of volume 800fc054-9ed8-4508-acf4-74a2bc051775 {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:33:26 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4beb6a0-98b2-4caa-95df-8298fda9a45c]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:33:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2ed5853e-6c17-4406-9920-635f92941268 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2ed5853e-6c17-4406-9920-635f92941268 tempest-VolumesDeleteCascade-433107890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435" returned: 0 in 0.381s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:26 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-2ed5853e-6c17-4406-9920-635f92941268 tempest-VolumesDeleteCascade-433107890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-800fc054-9ed8-4508-acf4-74a2bc051775(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:33:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2ed5853e-6c17-4406-9920-635f92941268 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.3526b94e-cb82-4a56-b021-5367f4150ac4 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:26 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=94, name=volume-800fc054-9ed8-4508-acf4-74a2bc051775.3526b94e-cb82-4a56-b021-5367f4150ac4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:33:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2ed5853e-6c17-4406-9920-635f92941268 tempest-VolumesDeleteCascade-433107890 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.3526b94e-cb82-4a56-b021-5367f4150ac4 1G" returned: 0 in 0.316s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2ed5853e-6c17-4406-9920-635f92941268 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): qemu-img rebase -u -b volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.3526b94e-cb82-4a56-b021-5367f4150ac4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2ed5853e-6c17-4406-9920-635f92941268 tempest-VolumesDeleteCascade-433107890 None] CMD "qemu-img rebase -u -b volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.3526b94e-cb82-4a56-b021-5367f4150ac4" returned: 0 in 0.149s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-2ed5853e-6c17-4406-9920-635f92941268 tempest-VolumesDeleteCascade-433107890 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.3526b94e-cb82-4a56-b021-5367f4150ac4 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:33:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2ed5853e-6c17-4406-9920-635f92941268 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.3526b94e-cb82-4a56-b021-5367f4150ac4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2ed5853e-6c17-4406-9920-635f92941268 tempest-VolumesDeleteCascade-433107890 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.3526b94e-cb82-4a56-b021-5367f4150ac4" returned: 0 in 0.124s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-2ed5853e-6c17-4406-9920-635f92941268 tempest-VolumesDeleteCascade-433107890 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435 -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:33:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2ed5853e-6c17-4406-9920-635f92941268 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.3526b94e-cb82-4a56-b021-5367f4150ac4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2ed5853e-6c17-4406-9920-635f92941268 tempest-VolumesDeleteCascade-433107890 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.3526b94e-cb82-4a56-b021-5367f4150ac4" returned: 0 in 0.085s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2ed5853e-6c17-4406-9920-635f92941268 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.341s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:33:27 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-2ed5853e-6c17-4406-9920-635f92941268 tempest-VolumesDeleteCascade-433107890 None] Create snapshot completed successfully
Sep 22 23:33:28 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "cinder-800fc054-9ed8-4508-acf4-74a2bc051775-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:33:28 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-800fc054-9ed8-4508-acf4-74a2bc051775-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:33:28 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:33:28 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Performing cascade delete. {{(pid=84012) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 22 23:33:28 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "cinder-3526b94e-cb82-4a56-b021-5367f4150ac4-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:33:28 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-3526b94e-cb82-4a56-b021-5367f4150ac4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:33:28 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:33:28 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "cinder-quobyte-800fc054-9ed8-4508-acf4-74a2bc051775" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:33:28 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-800fc054-9ed8-4508-acf4-74a2bc051775" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:33:28 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "cinder-quobyte-3526b94e-cb82-4a56-b021-5367f4150ac4" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:33:28 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-3526b94e-cb82-4a56-b021-5367f4150ac4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:33:28 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Deleting offline snapshot 3526b94e-cb82-4a56-b021-5367f4150ac4 of volume 800fc054-9ed8-4508-acf4-74a2bc051775 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:33:28 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] snapshot_file for this snap is: volume-800fc054-9ed8-4508-acf4-74a2bc051775.3526b94e-cb82-4a56-b021-5367f4150ac4 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:33:28 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5b3132-7bae-4bf4-9fec-911f5059b738]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:33:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.3526b94e-cb82-4a56-b021-5367f4150ac4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:29 devstack quobyte-client[84065]: System call of process 97269 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:33:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.3526b94e-cb82-4a56-b021-5367f4150ac4" returned: 0 in 0.436s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-800fc054-9ed8-4508-acf4-74a2bc051775(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:33:29 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cae58b4-35e3-4b62-9bc6-6ef5655e05f5]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:33:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:29 devstack quobyte-client[84065]: System call of process 97272 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:33:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435" returned: 0 in 0.422s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-800fc054-9ed8-4508-acf4-74a2bc051775(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:33:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.3526b94e-cb82-4a56-b021-5367f4150ac4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:29 devstack quobyte-client[84065]: System call of process 97275 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:33:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.3526b94e-cb82-4a56-b021-5367f4150ac4" returned: 0 in 0.267s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.3526b94e-cb82-4a56-b021-5367f4150ac4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.3526b94e-cb82-4a56-b021-5367f4150ac4" returned: 0 in 0.098s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:30 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-3526b94e-cb82-4a56-b021-5367f4150ac4" released by "_delete_snapshot" :: held 1.551s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:33:30 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-800fc054-9ed8-4508-acf4-74a2bc051775" released by "delete_snapshot" :: held 1.577s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:33:30 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Created reservations ['75f30a18-f0c2-4a79-8cfc-6d93fdfdc5ef', 'ed139504-470b-48b6-bdf6-91b2270bfa96', '40084780-0781-46af-9830-9637d96af772', '94931590-98be-40ee-85d5-a524b970ee31'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:33:30 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Delete snapshot completed successfully.
Sep 22 23:33:30 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-3526b94e-cb82-4a56-b021-5367f4150ac4-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:33:30 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "cinder-f949f456-1f92-4965-b75a-3fa56090d435-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:33:30 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-f949f456-1f92-4965-b75a-3fa56090d435-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:33:30 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:33:30 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "cinder-quobyte-800fc054-9ed8-4508-acf4-74a2bc051775" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:33:30 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-800fc054-9ed8-4508-acf4-74a2bc051775" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:33:30 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "cinder-quobyte-f949f456-1f92-4965-b75a-3fa56090d435" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:33:30 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-f949f456-1f92-4965-b75a-3fa56090d435" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:33:30 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Deleting offline snapshot f949f456-1f92-4965-b75a-3fa56090d435 of volume 800fc054-9ed8-4508-acf4-74a2bc051775 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:33:30 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] snapshot_file for this snap is: volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:33:30 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[351d2044-b560-4c90-a8e4-a7386ec59a94]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:33:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435" returned: 0 in 0.395s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:31 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-800fc054-9ed8-4508-acf4-74a2bc051775(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:33:31 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[72307bff-24fb-4847-80d7-6da8db3840ce]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:33:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775" returned: 0 in 0.450s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435" returned: 0 in 0.210s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775.f949f456-1f92-4965-b75a-3fa56090d435" returned: 0 in 0.092s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:32 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-f949f456-1f92-4965-b75a-3fa56090d435" released by "_delete_snapshot" :: held 1.476s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:33:32 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-800fc054-9ed8-4508-acf4-74a2bc051775" released by "delete_snapshot" :: held 1.503s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:33:32 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Created reservations ['da8e2e8d-a64c-48c7-ac27-381b1baafad6', '013c73f5-ad2a-4aec-ab54-913d1078395a', 'd3fb1a43-ec15-400a-9fba-9bbf7506aa15', '5d7c6ce8-4fe1-4fe1-b6b2-107e728223ce'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:33:32 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Delete snapshot completed successfully.
Sep 22 23:33:32 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-f949f456-1f92-4965-b75a-3fa56090d435-delete_snapshot" released by "delete_snapshot" :: held 2.141s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:33:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Snapshots deleted, issuing volume delete {{(pid=84012) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 22 23:33:32 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "cinder-quobyte-800fc054-9ed8-4508-acf4-74a2bc051775" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:33:33 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-800fc054-9ed8-4508-acf4-74a2bc051775" acquired by "delete_volume" :: waited 0.023s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:33:33 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac4a89b-f60d-483a-8f7a-b580423fc68b]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:33:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775" returned: 0 in 0.622s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-800fc054-9ed8-4508-acf4-74a2bc051775" returned: 0 in 0.127s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:33 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-800fc054-9ed8-4508-acf4-74a2bc051775" released by "delete_volume" :: held 0.981s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:33:34 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Created reservations ['c432768f-b2da-4666-bd49-4d66ba5f184d', '531ee400-3077-465e-8c3a-977fdd898e65', 'a83d8531-c951-48dc-a798-4420f91f23df', '40b8bdba-d69c-46c5-aa87-53313fa3fd37'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:33:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:33:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:33:34 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:33:34 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:33:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:33:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.135s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:34 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:33:34 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Deleted volume successfully.
Sep 22 23:33:34 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9c41bb21-88ac-47c0-90b4-02cd984dabca tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-800fc054-9ed8-4508-acf4-74a2bc051775-delete_volume" released by "delete_volume" :: held 6.559s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:33:36 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Flow 'volume_create_manager' (41cbe195-d555-4991-915e-94a6b7cc3678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c920e9-0a35-40b2-8136-b86fe818518f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c920e9-0a35-40b2-8136-b86fe818518f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-106489929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c699695d-025e-412b-a6a4-fd2404690197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4df08240634f08a666ef4495e3cbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:33:36Z,use_quota=True,user_id='a8ba9fe621ae4fb386d2187b515e2eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c025dad9-d691-42e9-849f-324bf7030baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c025dad9-d691-42e9-849f-324bf7030baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (157c57d9-51a7-4b1b-86b1-6accead94a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (157c57d9-51a7-4b1b-86b1-6accead94a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c699695d-025e-412b-a6a4-fd2404690197', 'volume_name': 'volume-c699695d-025e-412b-a6a4-fd2404690197', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b68b35-43c7-4d3b-a582-df1900cef23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b68b35-43c7-4d3b-a582-df1900cef23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf56b815-19e4-48c9-9776-5e10b81bce86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:33:36 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Volume c699695d-025e-412b-a6a4-fd2404690197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c699695d-025e-412b-a6a4-fd2404690197', 'volume_size': 1}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-106489929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c699695d-025e-412b-a6a4-fd2404690197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4df08240634f08a666ef4495e3cbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:33:36Z,use_quota=True,user_id='a8ba9fe621ae4fb386d2187b515e2eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Creating volume c699695d-025e-412b-a6a4-fd2404690197 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:33:36 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:36 devstack quobyte-client[84065]: System call of process 97302 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:33:36 devstack quobyte-client[84065]: System call of process 97302 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:33:36 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=95, name=volume-c699695d-025e-412b-a6a4-fd2404690197, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197 1073741824" returned: 0 in 0.358s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197" returned: 0 in 0.121s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] <== create_volume: return (543ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:33:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.554s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:33:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf56b815-19e4-48c9-9776-5e10b81bce86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c699695d-025e-412b-a6a4-fd2404690197', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:33:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf639071-4c3b-4df9-8eb8-76c2e0a1ed9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:33:37 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Volume volume-c699695d-025e-412b-a6a4-fd2404690197 (c699695d-025e-412b-a6a4-fd2404690197): created successfully
Sep 22 23:33:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf639071-4c3b-4df9-8eb8-76c2e0a1ed9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:33:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Flow 'volume_create_manager' (41cbe195-d555-4991-915e-94a6b7cc3678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:33:37 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-c9c8011f-cfb6-49a0-b4ae-530c9f0b6c52 tempest-VolumesDeleteCascade-433107890 None] Created volume successfully.
Sep 22 23:33:38 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:33:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:33:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:33:38 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] Creating offline snapshot fc11a133-cabc-4ed9-a2a3-eca105254a72 of volume c699695d-025e-412b-a6a4-fd2404690197 {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:33:38 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6103b1fb-1774-40dd-b1ee-9c5f48aba961]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:33:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197" returned: 0 in 0.430s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.fc11a133-cabc-4ed9-a2a3-eca105254a72 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:39 devstack quobyte-client[84065]: System call of process 97309 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:33:39 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=96, name=volume-c699695d-025e-412b-a6a4-fd2404690197.fc11a133-cabc-4ed9-a2a3-eca105254a72, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:33:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.fc11a133-cabc-4ed9-a2a3-eca105254a72 1G" returned: 0 in 0.288s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c699695d-025e-412b-a6a4-fd2404690197 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.fc11a133-cabc-4ed9-a2a3-eca105254a72 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:39 devstack quobyte-client[84065]: System call of process 97322 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:33:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] CMD "qemu-img rebase -u -b volume-c699695d-025e-412b-a6a4-fd2404690197 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.fc11a133-cabc-4ed9-a2a3-eca105254a72" returned: 0 in 0.203s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.fc11a133-cabc-4ed9-a2a3-eca105254a72 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:33:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.fc11a133-cabc-4ed9-a2a3-eca105254a72 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.fc11a133-cabc-4ed9-a2a3-eca105254a72" returned: 0 in 0.173s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197 -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:33:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.fc11a133-cabc-4ed9-a2a3-eca105254a72 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.fc11a133-cabc-4ed9-a2a3-eca105254a72" returned: 0 in 0.157s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.info" returned: 0 in 0.120s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.info is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:33:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.info" returned: 0 in 0.107s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.889s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:33:40 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-9bc9652b-862d-42d3-81f0-38d807771f66 tempest-VolumesDeleteCascade-433107890 None] Create snapshot completed successfully
Sep 22 23:33:41 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:33:41 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Flow 'volume_create_manager' (7dd7f236-0ed2-482b-a52f-1b3a8b7c8321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce897b8-ca04-4124-9d53-d14a5ae2aef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce897b8-ca04-4124-9d53-d14a5ae2aef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-974527253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d9ba09-18f8-42ef-8ebc-b803e72ea47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4df08240634f08a666ef4495e3cbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fc11a133-cabc-4ed9-a2a3-eca105254a72,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:33:42Z,use_quota=True,user_id='a8ba9fe621ae4fb386d2187b515e2eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a29a84d-98c5-47a6-a0e1-1aa95974c317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a29a84d-98c5-47a6-a0e1-1aa95974c317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fb529c-a1b1-4fee-a4e3-5868953aedc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fb529c-a1b1-4fee-a4e3-5868953aedc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c5d9ba09-18f8-42ef-8ebc-b803e72ea47e', 'volume_name': 'volume-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e', 'volume_size': 1, 'snapshot_id': 'fc11a133-cabc-4ed9-a2a3-eca105254a72'}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0356faa-4cb2-495d-a9ea-668bb91d06b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0356faa-4cb2-495d-a9ea-668bb91d06b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc23588-aee5-4d68-bc3b-30ad5bb330c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:33:42 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Volume c5d9ba09-18f8-42ef-8ebc-b803e72ea47e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e', 'volume_size': 1, 'snapshot_id': 'fc11a133-cabc-4ed9-a2a3-eca105254a72'}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "cinder-quobyte-fc11a133-cabc-4ed9-a2a3-eca105254a72-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e" by "_create_volume_from_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-fc11a133-cabc-4ed9-a2a3-eca105254a72-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Creating volume c5d9ba09-18f8-42ef-8ebc-b803e72ea47e from snapshot fc11a133-cabc-4ed9-a2a3-eca105254a72 {{(pid=84012) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "cinder-quobyte-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e" by "_copy_volume_from_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] snapshot: fc11a133-cabc-4ed9-a2a3-eca105254a72, volume: c5d9ba09-18f8-42ef-8ebc-b803e72ea47e,  {{(pid=84012) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73909cf-b79e-4c99-a612-75c7295c8400]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.fc11a133-cabc-4ed9-a2a3-eca105254a72 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:42 devstack quobyte-client[84065]: System call of process 97351 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.fc11a133-cabc-4ed9-a2a3-eca105254a72" returned: 0 in 0.386s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c699695d-025e-412b-a6a4-fd2404690197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197 {{(pid=84012) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Creating direct copy from snapshot {{(pid=84012) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[22840a99-c300-4f51-b5d8-543a14e65ef9]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:33:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197" returned: 0 in 0.421s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:43 devstack cinder-volume[84012]: DEBUG cinder.utils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e not found in is_blk_device check {{(pid=84012) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 22 23:33:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:43 devstack quobyte-client[84065]: System call of process 97357 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:33:43 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=98, name=volume-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:33:44 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-f4214de4-cbb0-4276-9483-aa0206803b07 req-77f6ba5a-0446-4a80-bed5-64162bf3ad45 tempest-AttachVolumeTestJSON-1520125212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:33:45 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-f4214de4-cbb0-4276-9483-aa0206803b07 req-77f6ba5a-0446-4a80-bed5-64162bf3ad45 tempest-AttachVolumeTestJSON-1520125212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:33:45 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-f4214de4-cbb0-4276-9483-aa0206803b07 req-77f6ba5a-0446-4a80-bed5-64162bf3ad45 tempest-AttachVolumeTestJSON-1520125212 None] Terminate volume connection completed successfully.
Sep 22 23:33:45 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-f4214de4-cbb0-4276-9483-aa0206803b07 req-77f6ba5a-0446-4a80-bed5-64162bf3ad45 tempest-AttachVolumeTestJSON-1520125212 None] Deleting attachment 7748cec6-0493-4d00-8d84-870df205f7d1. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:33:47 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:33:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:33:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:33:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:33:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:33:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:33:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.510s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:33:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e" returned: 0 in 7.352s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:50 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[554aba43-54a6-4b5a-b01e-9057a5cbf4ce]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:33:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:52 devstack quobyte-client[84065]: System call of process 97375 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:33:52 devstack quobyte-client[84065]: System call of process 97375 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:33:52 devstack quobyte-client[84065]: System call of process 97375 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:33:52 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=26,cinder:UPDATE=22,cinder:DELETE=2,cinder:INSERT=4 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:33:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197" returned: 0 in 1.883s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:52 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Image conversion details: src /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197, size 1024.00 MB, duration 7.36 sec, destination /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e {{(pid=84012) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 22 23:33:52 devstack cinder-volume[84012]: INFO cinder.image.image_utils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Converted 1024.00 MB image at 139.08 MB/s
Sep 22 23:33:52 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:33:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e" returned: 0 in 0.138s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e" released by "_copy_volume_from_snapshot" :: held 10.543s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:33:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-fc11a133-cabc-4ed9-a2a3-eca105254a72-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e" released by "_create_volume_from_snapshot" :: held 10.582s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:33:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.602s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:33:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc23588-aee5-4d68-bc3b-30ad5bb330c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e', 'volume_size': 1, 'snapshot_id': 'fc11a133-cabc-4ed9-a2a3-eca105254a72'}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:33:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180c0fd4-bece-499e-8d14-0490d3a2f6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:33:53 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Volume volume-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e (c5d9ba09-18f8-42ef-8ebc-b803e72ea47e): created successfully
Sep 22 23:33:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180c0fd4-bece-499e-8d14-0490d3a2f6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:33:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Flow 'volume_create_manager' (7dd7f236-0ed2-482b-a52f-1b3a8b7c8321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:33:53 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-0a24f550-fe5b-411f-b99b-8339c3365660 tempest-VolumesDeleteCascade-433107890 None] Created volume successfully.
Sep 22 23:33:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "cinder-c699695d-025e-412b-a6a4-fd2404690197-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:33:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-c699695d-025e-412b-a6a4-fd2404690197-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:33:54 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:33:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Performing cascade delete. {{(pid=84012) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 22 23:33:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "cinder-fc11a133-cabc-4ed9-a2a3-eca105254a72-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:33:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-fc11a133-cabc-4ed9-a2a3-eca105254a72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:33:54 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:33:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "cinder-quobyte-c699695d-025e-412b-a6a4-fd2404690197" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:33:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-c699695d-025e-412b-a6a4-fd2404690197" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:33:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "cinder-quobyte-fc11a133-cabc-4ed9-a2a3-eca105254a72" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:33:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-fc11a133-cabc-4ed9-a2a3-eca105254a72" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:33:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Deleting offline snapshot fc11a133-cabc-4ed9-a2a3-eca105254a72 of volume c699695d-025e-412b-a6a4-fd2404690197 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:33:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] snapshot_file for this snap is: volume-c699695d-025e-412b-a6a4-fd2404690197.fc11a133-cabc-4ed9-a2a3-eca105254a72 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:33:54 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae34b14-93af-4903-b2ae-2703d0723e42]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:33:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.fc11a133-cabc-4ed9-a2a3-eca105254a72 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:55 devstack quobyte-client[84065]: System call of process 97419 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:33:55 devstack quobyte-client[84065]: System call of process 97419 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:33:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.fc11a133-cabc-4ed9-a2a3-eca105254a72" returned: 0 in 0.517s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c699695d-025e-412b-a6a4-fd2404690197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:33:55 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a354f2-e468-47ae-bd23-d3305ecbb018]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:33:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197" returned: 0 in 0.493s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.fc11a133-cabc-4ed9-a2a3-eca105254a72 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.fc11a133-cabc-4ed9-a2a3-eca105254a72" returned: 0 in 0.251s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.fc11a133-cabc-4ed9-a2a3-eca105254a72 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197.fc11a133-cabc-4ed9-a2a3-eca105254a72" returned: 0 in 0.089s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:56 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-fc11a133-cabc-4ed9-a2a3-eca105254a72" released by "_delete_snapshot" :: held 1.715s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:33:56 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-c699695d-025e-412b-a6a4-fd2404690197" released by "delete_snapshot" :: held 1.746s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:33:56 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Created reservations ['ff0a57e3-acd8-4dca-aa9d-82ec8913138d', '43ad779e-26f7-4ee8-850a-406b75154af7', '3f81a844-3364-41c3-a62f-935c635de68a', '3080740a-d2d8-4873-95b1-6bad327c9c92'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:33:57 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Delete snapshot completed successfully.
Sep 22 23:33:57 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-fc11a133-cabc-4ed9-a2a3-eca105254a72-delete_snapshot" released by "delete_snapshot" :: held 2.284s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:33:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Snapshots deleted, issuing volume delete {{(pid=84012) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 22 23:33:57 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "cinder-quobyte-c699695d-025e-412b-a6a4-fd2404690197" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:33:57 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-c699695d-025e-412b-a6a4-fd2404690197" acquired by "delete_volume" :: waited 0.015s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:33:57 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3548dd56-09c6-4274-b14b-1a09073cb898]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:33:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:57 devstack quobyte-client[84065]: System call of process 97429 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:33:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197" returned: 0 in 0.462s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c699695d-025e-412b-a6a4-fd2404690197" returned: 0 in 0.095s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:57 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-c699695d-025e-412b-a6a4-fd2404690197" released by "delete_volume" :: held 0.763s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:33:58 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Created reservations ['f952f8d5-35a3-4dc6-ad75-7b725268ee0e', 'b3de84b3-ae48-4f94-9e21-886781bf7bb3', 'd373b868-6dbd-4353-9534-cce1d1a694f9', 'fdf73c40-26a8-43ce-846f-b66f57945546'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:33:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:33:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:33:58 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:33:58 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:33:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:33:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:33:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.145s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:33:58 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:33:58 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Deleted volume successfully.
Sep 22 23:33:58 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c4f7e656-ca01-4547-b94f-a29db188bcb2 tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-c699695d-025e-412b-a6a4-fd2404690197-delete_volume" released by "delete_volume" :: held 4.108s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:33:59 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ae7c3895-38f8-4ba2-ac06-526fbfba4b90 tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "cinder-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:33:59 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ae7c3895-38f8-4ba2-ac06-526fbfba4b90 tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:33:59 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-ae7c3895-38f8-4ba2-ac06-526fbfba4b90 tempest-VolumesDeleteCascade-433107890 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:33:59 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ae7c3895-38f8-4ba2-ac06-526fbfba4b90 tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "cinder-quobyte-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:33:59 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ae7c3895-38f8-4ba2-ac06-526fbfba4b90 tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e" acquired by "delete_volume" :: waited 0.018s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:33:59 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4296892b-0b9e-4eee-ad4d-3d77210a33be]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:33:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ae7c3895-38f8-4ba2-ac06-526fbfba4b90 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:00 devstack quobyte-client[84065]: System call of process 97440 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:34:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ae7c3895-38f8-4ba2-ac06-526fbfba4b90 tempest-VolumesDeleteCascade-433107890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e" returned: 0 in 0.575s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ae7c3895-38f8-4ba2-ac06-526fbfba4b90 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:00 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9f397575-926e-4679-a6cf-cfee7d63e736 tempest-AttachVolumeTestJSON-1520125212 None] Acquiring lock "cinder-6e71f94c-c4c4-460a-85b5-9f8abf428406-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:34:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ae7c3895-38f8-4ba2-ac06-526fbfba4b90 tempest-VolumesDeleteCascade-433107890 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e" returned: 0 in 0.370s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:00 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9f397575-926e-4679-a6cf-cfee7d63e736 tempest-AttachVolumeTestJSON-1520125212 None] Lock "cinder-6e71f94c-c4c4-460a-85b5-9f8abf428406-delete_volume" acquired by "delete_volume" :: waited 0.181s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:34:00 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ae7c3895-38f8-4ba2-ac06-526fbfba4b90 tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-quobyte-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e" released by "delete_volume" :: held 1.277s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:34:01 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-9f397575-926e-4679-a6cf-cfee7d63e736 tempest-AttachVolumeTestJSON-1520125212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:34:01 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9f397575-926e-4679-a6cf-cfee7d63e736 tempest-AttachVolumeTestJSON-1520125212 None] Acquiring lock "cinder-quobyte-6e71f94c-c4c4-460a-85b5-9f8abf428406" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:34:01 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9f397575-926e-4679-a6cf-cfee7d63e736 tempest-AttachVolumeTestJSON-1520125212 None] Lock "cinder-quobyte-6e71f94c-c4c4-460a-85b5-9f8abf428406" acquired by "delete_volume" :: waited 0.038s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:34:01 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[968d4d0e-3823-4202-9bd4-68eaf9138613]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:34:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9f397575-926e-4679-a6cf-cfee7d63e736 tempest-AttachVolumeTestJSON-1520125212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6e71f94c-c4c4-460a-85b5-9f8abf428406 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:01 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-ae7c3895-38f8-4ba2-ac06-526fbfba4b90 tempest-VolumesDeleteCascade-433107890 None] Created reservations ['18ce455d-0c32-47f2-8c28-f05b243f175e', 'f36b5863-e045-4677-b863-b21334a836e6', '5541468f-08b4-49b4-a38f-582f410c40c1', '47851f25-2fab-4d13-975d-db588c8364b4'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:34:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ae7c3895-38f8-4ba2-ac06-526fbfba4b90 tempest-VolumesDeleteCascade-433107890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:34:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ae7c3895-38f8-4ba2-ac06-526fbfba4b90 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:34:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ae7c3895-38f8-4ba2-ac06-526fbfba4b90 tempest-VolumesDeleteCascade-433107890 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:34:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ae7c3895-38f8-4ba2-ac06-526fbfba4b90 tempest-VolumesDeleteCascade-433107890 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:34:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ae7c3895-38f8-4ba2-ac06-526fbfba4b90 tempest-VolumesDeleteCascade-433107890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:34:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ae7c3895-38f8-4ba2-ac06-526fbfba4b90 tempest-VolumesDeleteCascade-433107890 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:01 devstack quobyte-client[84065]: System call of process 97444 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:34:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9f397575-926e-4679-a6cf-cfee7d63e736 tempest-AttachVolumeTestJSON-1520125212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6e71f94c-c4c4-460a-85b5-9f8abf428406" returned: 0 in 0.615s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9f397575-926e-4679-a6cf-cfee7d63e736 tempest-AttachVolumeTestJSON-1520125212 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6e71f94c-c4c4-460a-85b5-9f8abf428406 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ae7c3895-38f8-4ba2-ac06-526fbfba4b90 tempest-VolumesDeleteCascade-433107890 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.287s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:02 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-ae7c3895-38f8-4ba2-ac06-526fbfba4b90 tempest-VolumesDeleteCascade-433107890 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:34:02 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-ae7c3895-38f8-4ba2-ac06-526fbfba4b90 tempest-VolumesDeleteCascade-433107890 None] Deleted volume successfully.
Sep 22 23:34:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9f397575-926e-4679-a6cf-cfee7d63e736 tempest-AttachVolumeTestJSON-1520125212 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6e71f94c-c4c4-460a-85b5-9f8abf428406" returned: 0 in 0.480s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:02 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9f397575-926e-4679-a6cf-cfee7d63e736 tempest-AttachVolumeTestJSON-1520125212 None] Lock "cinder-quobyte-6e71f94c-c4c4-460a-85b5-9f8abf428406" released by "delete_volume" :: held 1.247s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:34:02 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ae7c3895-38f8-4ba2-ac06-526fbfba4b90 tempest-VolumesDeleteCascade-433107890 None] Lock "cinder-c5d9ba09-18f8-42ef-8ebc-b803e72ea47e-delete_volume" released by "delete_volume" :: held 2.942s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:34:02 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-9f397575-926e-4679-a6cf-cfee7d63e736 tempest-AttachVolumeTestJSON-1520125212 None] Created reservations ['ae3b5235-0a60-44b4-829a-e77268b3277b', '8ffd128f-07e0-4cfd-9a37-33afcac554d0', '03436825-5381-4c2c-81bc-ef1b68171ab4', 'e1d144ed-1684-44fb-9296-f880137f4845'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:34:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9f397575-926e-4679-a6cf-cfee7d63e736 tempest-AttachVolumeTestJSON-1520125212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:34:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9f397575-926e-4679-a6cf-cfee7d63e736 tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:34:02 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-9f397575-926e-4679-a6cf-cfee7d63e736 tempest-AttachVolumeTestJSON-1520125212 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:34:02 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-9f397575-926e-4679-a6cf-cfee7d63e736 tempest-AttachVolumeTestJSON-1520125212 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:34:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9f397575-926e-4679-a6cf-cfee7d63e736 tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:34:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9f397575-926e-4679-a6cf-cfee7d63e736 tempest-AttachVolumeTestJSON-1520125212 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:02 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d5d5f77c-4741-4870-88e8-adfe491e6a0e tempest-AttachVolumeTestJSON-1520125212 None] Acquiring lock "cinder-082c036e-7fdb-4f4c-82a9-395ea04ffdc4-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:34:03 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9f397575-926e-4679-a6cf-cfee7d63e736 tempest-AttachVolumeTestJSON-1520125212 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.398s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:03 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-9f397575-926e-4679-a6cf-cfee7d63e736 tempest-AttachVolumeTestJSON-1520125212 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:34:03 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d5d5f77c-4741-4870-88e8-adfe491e6a0e tempest-AttachVolumeTestJSON-1520125212 None] Lock "cinder-082c036e-7fdb-4f4c-82a9-395ea04ffdc4-delete_volume" acquired by "delete_volume" :: waited 0.175s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:34:03 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-9f397575-926e-4679-a6cf-cfee7d63e736 tempest-AttachVolumeTestJSON-1520125212 None] Deleted volume successfully.
Sep 22 23:34:03 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-d5d5f77c-4741-4870-88e8-adfe491e6a0e tempest-AttachVolumeTestJSON-1520125212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:34:03 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d5d5f77c-4741-4870-88e8-adfe491e6a0e tempest-AttachVolumeTestJSON-1520125212 None] Acquiring lock "cinder-quobyte-082c036e-7fdb-4f4c-82a9-395ea04ffdc4" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:34:03 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9f397575-926e-4679-a6cf-cfee7d63e736 tempest-AttachVolumeTestJSON-1520125212 None] Lock "cinder-6e71f94c-c4c4-460a-85b5-9f8abf428406-delete_volume" released by "delete_volume" :: held 2.619s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:34:03 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d5d5f77c-4741-4870-88e8-adfe491e6a0e tempest-AttachVolumeTestJSON-1520125212 None] Lock "cinder-quobyte-082c036e-7fdb-4f4c-82a9-395ea04ffdc4" acquired by "delete_volume" :: waited 0.038s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:34:03 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a6a35e-361f-4a8f-a09d-1a4533350f7e]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:34:03 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d5d5f77c-4741-4870-88e8-adfe491e6a0e tempest-AttachVolumeTestJSON-1520125212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-082c036e-7fdb-4f4c-82a9-395ea04ffdc4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:04 devstack quobyte-client[84065]: System call of process 97450 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:34:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d5d5f77c-4741-4870-88e8-adfe491e6a0e tempest-AttachVolumeTestJSON-1520125212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-082c036e-7fdb-4f4c-82a9-395ea04ffdc4" returned: 0 in 0.568s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d5d5f77c-4741-4870-88e8-adfe491e6a0e tempest-AttachVolumeTestJSON-1520125212 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-082c036e-7fdb-4f4c-82a9-395ea04ffdc4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d5d5f77c-4741-4870-88e8-adfe491e6a0e tempest-AttachVolumeTestJSON-1520125212 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-082c036e-7fdb-4f4c-82a9-395ea04ffdc4" returned: 0 in 0.102s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d5d5f77c-4741-4870-88e8-adfe491e6a0e tempest-AttachVolumeTestJSON-1520125212 None] Lock "cinder-quobyte-082c036e-7fdb-4f4c-82a9-395ea04ffdc4" released by "delete_volume" :: held 0.886s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:34:04 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-d5d5f77c-4741-4870-88e8-adfe491e6a0e tempest-AttachVolumeTestJSON-1520125212 None] Created reservations ['80782d56-d30a-4a30-ac40-fbe518f2e5a3', 'd3713395-10fd-4360-96c7-03dce22df15d', '110f7e50-05a0-4d6f-af42-2839e1c1f955', '9ec06320-9560-4bf0-b94c-2011aa79df27'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:34:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d5d5f77c-4741-4870-88e8-adfe491e6a0e tempest-AttachVolumeTestJSON-1520125212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:34:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d5d5f77c-4741-4870-88e8-adfe491e6a0e tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:34:04 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5f77c-4741-4870-88e8-adfe491e6a0e tempest-AttachVolumeTestJSON-1520125212 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:34:04 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5f77c-4741-4870-88e8-adfe491e6a0e tempest-AttachVolumeTestJSON-1520125212 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:34:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d5d5f77c-4741-4870-88e8-adfe491e6a0e tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:34:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d5d5f77c-4741-4870-88e8-adfe491e6a0e tempest-AttachVolumeTestJSON-1520125212 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d5d5f77c-4741-4870-88e8-adfe491e6a0e tempest-AttachVolumeTestJSON-1520125212 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.122s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:05 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-d5d5f77c-4741-4870-88e8-adfe491e6a0e tempest-AttachVolumeTestJSON-1520125212 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:34:05 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-d5d5f77c-4741-4870-88e8-adfe491e6a0e tempest-AttachVolumeTestJSON-1520125212 None] Deleted volume successfully.
Sep 22 23:34:05 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1e3ad46f-c691-4768-a006-e13b373b5163 tempest-AttachVolumeTestJSON-1520125212 None] Acquiring lock "cinder-7e99834f-b8b0-41a5-a78c-0d025d89fb91-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:34:05 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d5d5f77c-4741-4870-88e8-adfe491e6a0e tempest-AttachVolumeTestJSON-1520125212 None] Lock "cinder-082c036e-7fdb-4f4c-82a9-395ea04ffdc4-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:34:05 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1e3ad46f-c691-4768-a006-e13b373b5163 tempest-AttachVolumeTestJSON-1520125212 None] Lock "cinder-7e99834f-b8b0-41a5-a78c-0d025d89fb91-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:34:05 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-1e3ad46f-c691-4768-a006-e13b373b5163 tempest-AttachVolumeTestJSON-1520125212 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:34:05 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1e3ad46f-c691-4768-a006-e13b373b5163 tempest-AttachVolumeTestJSON-1520125212 None] Acquiring lock "cinder-quobyte-7e99834f-b8b0-41a5-a78c-0d025d89fb91" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:34:05 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1e3ad46f-c691-4768-a006-e13b373b5163 tempest-AttachVolumeTestJSON-1520125212 None] Lock "cinder-quobyte-7e99834f-b8b0-41a5-a78c-0d025d89fb91" acquired by "delete_volume" :: waited 0.023s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:34:05 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[90656cce-28e5-4607-afac-1838e3da34c5]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:34:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e3ad46f-c691-4768-a006-e13b373b5163 tempest-AttachVolumeTestJSON-1520125212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7e99834f-b8b0-41a5-a78c-0d025d89fb91 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:06 devstack quobyte-client[84065]: System call of process 97456 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:34:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e3ad46f-c691-4768-a006-e13b373b5163 tempest-AttachVolumeTestJSON-1520125212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7e99834f-b8b0-41a5-a78c-0d025d89fb91" returned: 0 in 0.485s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e3ad46f-c691-4768-a006-e13b373b5163 tempest-AttachVolumeTestJSON-1520125212 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7e99834f-b8b0-41a5-a78c-0d025d89fb91 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e3ad46f-c691-4768-a006-e13b373b5163 tempest-AttachVolumeTestJSON-1520125212 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7e99834f-b8b0-41a5-a78c-0d025d89fb91" returned: 0 in 0.095s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1e3ad46f-c691-4768-a006-e13b373b5163 tempest-AttachVolumeTestJSON-1520125212 None] Lock "cinder-quobyte-7e99834f-b8b0-41a5-a78c-0d025d89fb91" released by "delete_volume" :: held 0.792s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:34:06 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-1e3ad46f-c691-4768-a006-e13b373b5163 tempest-AttachVolumeTestJSON-1520125212 None] Created reservations ['df8886d9-a752-4d79-9f86-79f7a2eecb2b', '0102a7ac-c125-4fc1-a944-f1de275fc14e', '8fbb8125-505e-4040-9c8c-442dc54d34ab', '5713a22e-cb3d-4f6d-a500-f3dfcdc3ea91'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:34:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1e3ad46f-c691-4768-a006-e13b373b5163 tempest-AttachVolumeTestJSON-1520125212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:34:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1e3ad46f-c691-4768-a006-e13b373b5163 tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:34:07 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1e3ad46f-c691-4768-a006-e13b373b5163 tempest-AttachVolumeTestJSON-1520125212 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:34:07 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1e3ad46f-c691-4768-a006-e13b373b5163 tempest-AttachVolumeTestJSON-1520125212 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:34:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1e3ad46f-c691-4768-a006-e13b373b5163 tempest-AttachVolumeTestJSON-1520125212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:34:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e3ad46f-c691-4768-a006-e13b373b5163 tempest-AttachVolumeTestJSON-1520125212 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e3ad46f-c691-4768-a006-e13b373b5163 tempest-AttachVolumeTestJSON-1520125212 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.097s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:07 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-1e3ad46f-c691-4768-a006-e13b373b5163 tempest-AttachVolumeTestJSON-1520125212 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:34:07 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-1e3ad46f-c691-4768-a006-e13b373b5163 tempest-AttachVolumeTestJSON-1520125212 None] Deleted volume successfully.
Sep 22 23:34:07 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1e3ad46f-c691-4768-a006-e13b373b5163 tempest-AttachVolumeTestJSON-1520125212 None] Lock "cinder-7e99834f-b8b0-41a5-a78c-0d025d89fb91-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:34:08 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:34:08 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:34:08 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Flow 'volume_create_manager' (ee5e9d3e-a57b-4e28-9c69-cc6e47da95c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:34:08 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbcb3f1-3810-4680-a7fc-9bd18ede616c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:08 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbcb3f1-3810-4680-a7fc-9bd18ede616c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-500069547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74d4b779-42b7-4a7b-9adc-ab6bf13157b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8aa67c2f2044a5834185320027e3df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:34:09Z,use_quota=True,user_id='d8d4a7b09f424747876ccc2ae4b4830a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:08 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a781a7bb-ba91-466e-901e-ca73adab4acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:08 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a781a7bb-ba91-466e-901e-ca73adab4acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:08 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b255266-452a-4ea7-a06d-998337e2a37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:08 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b255266-452a-4ea7-a06d-998337e2a37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74d4b779-42b7-4a7b-9adc-ab6bf13157b9', 'volume_name': 'volume-74d4b779-42b7-4a7b-9adc-ab6bf13157b9', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:08 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1dd34b-49b9-4934-ae12-5b30ea9a894f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:08 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1dd34b-49b9-4934-ae12-5b30ea9a894f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:08 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21003093-fb7d-47bc-9c0d-1280ade56223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:08 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Volume 74d4b779-42b7-4a7b-9adc-ab6bf13157b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74d4b779-42b7-4a7b-9adc-ab6bf13157b9', 'volume_size': 1}
Sep 22 23:34:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:34:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:34:08 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-500069547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74d4b779-42b7-4a7b-9adc-ab6bf13157b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8aa67c2f2044a5834185320027e3df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:34:09Z,use_quota=True,user_id='d8d4a7b09f424747876ccc2ae4b4830a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:34:08 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Creating volume 74d4b779-42b7-4a7b-9adc-ab6bf13157b9 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:34:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:34:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:34:08 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:34:09 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:34:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:34:09 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:34:09 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:34:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-74d4b779-42b7-4a7b-9adc-ab6bf13157b9 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:09 devstack quobyte-client[84065]: System call of process 97461 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:34:09 devstack quobyte-client[84065]: System call of process 97461 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:34:09 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=99, name=volume-74d4b779-42b7-4a7b-9adc-ab6bf13157b9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:34:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-74d4b779-42b7-4a7b-9adc-ab6bf13157b9 1073741824" returned: 0 in 0.462s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-74d4b779-42b7-4a7b-9adc-ab6bf13157b9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-74d4b779-42b7-4a7b-9adc-ab6bf13157b9" returned: 0 in 0.152s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:09 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] <== create_volume: return (686ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:34:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:34:09 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21003093-fb7d-47bc-9c0d-1280ade56223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74d4b779-42b7-4a7b-9adc-ab6bf13157b9', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:09 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec772cd5-14a5-4145-a8dc-cd65382615bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:10 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Volume volume-74d4b779-42b7-4a7b-9adc-ab6bf13157b9 (74d4b779-42b7-4a7b-9adc-ab6bf13157b9): created successfully
Sep 22 23:34:10 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec772cd5-14a5-4145-a8dc-cd65382615bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:10 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Flow 'volume_create_manager' (ee5e9d3e-a57b-4e28-9c69-cc6e47da95c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:34:10 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-3fa6182e-3444-4e2c-acc9-031d52ddcb62 tempest-VolumesTransfersV355Test-884100550 None] Created volume successfully.
Sep 22 23:34:11 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-bb39cfc4-ce2d-4a0e-a218-463dca7d8347 tempest-VolumesTransfersV355Test-535977734 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:34:11 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-bb39cfc4-ce2d-4a0e-a218-463dca7d8347 tempest-VolumesTransfersV355Test-535977734 None] Transfer volume completed successfully.
Sep 22 23:34:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2dcec887-99ed-4610-ba13-462e5fa97208 tempest-VolumesTransfersV355Test-931346678 None] Acquiring lock "cinder-74d4b779-42b7-4a7b-9adc-ab6bf13157b9-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:34:13 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2dcec887-99ed-4610-ba13-462e5fa97208 tempest-VolumesTransfersV355Test-931346678 None] Lock "cinder-74d4b779-42b7-4a7b-9adc-ab6bf13157b9-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:34:13 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=59,cinder:UPDATE=80,cinder:DELETE=9,cinder:INSERT=22 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:34:13 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-2dcec887-99ed-4610-ba13-462e5fa97208 tempest-VolumesTransfersV355Test-931346678 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:34:13 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2dcec887-99ed-4610-ba13-462e5fa97208 tempest-VolumesTransfersV355Test-931346678 None] Acquiring lock "cinder-quobyte-74d4b779-42b7-4a7b-9adc-ab6bf13157b9" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:34:13 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2dcec887-99ed-4610-ba13-462e5fa97208 tempest-VolumesTransfersV355Test-931346678 None] Lock "cinder-quobyte-74d4b779-42b7-4a7b-9adc-ab6bf13157b9" acquired by "delete_volume" :: waited 0.022s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:34:13 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b641d28f-4eeb-4f37-b231-7c5da726739f]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:34:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2dcec887-99ed-4610-ba13-462e5fa97208 tempest-VolumesTransfersV355Test-931346678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-74d4b779-42b7-4a7b-9adc-ab6bf13157b9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2dcec887-99ed-4610-ba13-462e5fa97208 tempest-VolumesTransfersV355Test-931346678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-74d4b779-42b7-4a7b-9adc-ab6bf13157b9" returned: 0 in 0.527s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2dcec887-99ed-4610-ba13-462e5fa97208 tempest-VolumesTransfersV355Test-931346678 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-74d4b779-42b7-4a7b-9adc-ab6bf13157b9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2dcec887-99ed-4610-ba13-462e5fa97208 tempest-VolumesTransfersV355Test-931346678 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-74d4b779-42b7-4a7b-9adc-ab6bf13157b9" returned: 0 in 0.106s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:14 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2dcec887-99ed-4610-ba13-462e5fa97208 tempest-VolumesTransfersV355Test-931346678 None] Lock "cinder-quobyte-74d4b779-42b7-4a7b-9adc-ab6bf13157b9" released by "delete_volume" :: held 0.845s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:34:14 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-2dcec887-99ed-4610-ba13-462e5fa97208 tempest-VolumesTransfersV355Test-931346678 None] Created reservations ['404790c0-d823-4332-84ee-ba13aaaac74e', '89bc9c34-565f-40ed-a995-c7ae9111df83', '4cad1cc9-57c5-4936-8cbc-e521f98960f7', '980a7af5-e5a2-4443-805d-68a81defce82'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:34:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2dcec887-99ed-4610-ba13-462e5fa97208 tempest-VolumesTransfersV355Test-931346678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:34:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2dcec887-99ed-4610-ba13-462e5fa97208 tempest-VolumesTransfersV355Test-931346678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:34:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-2dcec887-99ed-4610-ba13-462e5fa97208 tempest-VolumesTransfersV355Test-931346678 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:34:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-2dcec887-99ed-4610-ba13-462e5fa97208 tempest-VolumesTransfersV355Test-931346678 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:34:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2dcec887-99ed-4610-ba13-462e5fa97208 tempest-VolumesTransfersV355Test-931346678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:34:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2dcec887-99ed-4610-ba13-462e5fa97208 tempest-VolumesTransfersV355Test-931346678 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2dcec887-99ed-4610-ba13-462e5fa97208 tempest-VolumesTransfersV355Test-931346678 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.100s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:14 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-2dcec887-99ed-4610-ba13-462e5fa97208 tempest-VolumesTransfersV355Test-931346678 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:34:14 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-2dcec887-99ed-4610-ba13-462e5fa97208 tempest-VolumesTransfersV355Test-931346678 None] Deleted volume successfully.
Sep 22 23:34:14 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2dcec887-99ed-4610-ba13-462e5fa97208 tempest-VolumesTransfersV355Test-931346678 None] Lock "cinder-74d4b779-42b7-4a7b-9adc-ab6bf13157b9-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:34:16 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Flow 'volume_create_manager' (d44b2f13-2c22-4426-98d6-5d8d08e47bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715d706b-d8bf-4125-8141-e475fde2bd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715d706b-d8bf-4125-8141-e475fde2bd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-816406122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a69d1af3-31e2-4d8b-95ac-b742a3c3e4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8aa67c2f2044a5834185320027e3df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:34:16Z,use_quota=True,user_id='d8d4a7b09f424747876ccc2ae4b4830a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909acea9-dfcf-439e-92ca-8c4f74325ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909acea9-dfcf-439e-92ca-8c4f74325ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4953d5a8-9ae0-4d44-a72e-60b257f271e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4953d5a8-9ae0-4d44-a72e-60b257f271e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a69d1af3-31e2-4d8b-95ac-b742a3c3e4af', 'volume_name': 'volume-a69d1af3-31e2-4d8b-95ac-b742a3c3e4af', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628852e2-3a0a-4a58-8e8d-590365db007f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628852e2-3a0a-4a58-8e8d-590365db007f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10dbea4-2040-405f-aed8-7d8115dca9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:16 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Volume a69d1af3-31e2-4d8b-95ac-b742a3c3e4af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a69d1af3-31e2-4d8b-95ac-b742a3c3e4af', 'volume_size': 1}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-816406122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a69d1af3-31e2-4d8b-95ac-b742a3c3e4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8aa67c2f2044a5834185320027e3df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:34:16Z,use_quota=True,user_id='d8d4a7b09f424747876ccc2ae4b4830a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Creating volume a69d1af3-31e2-4d8b-95ac-b742a3c3e4af {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:34:16 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a69d1af3-31e2-4d8b-95ac-b742a3c3e4af 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:16 devstack quobyte-client[84065]: System call of process 97473 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:34:16 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=100, name=volume-a69d1af3-31e2-4d8b-95ac-b742a3c3e4af, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a69d1af3-31e2-4d8b-95ac-b742a3c3e4af 1073741824" returned: 0 in 0.413s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a69d1af3-31e2-4d8b-95ac-b742a3c3e4af {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a69d1af3-31e2-4d8b-95ac-b742a3c3e4af" returned: 0 in 0.140s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] <== create_volume: return (643ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:34:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.655s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:34:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10dbea4-2040-405f-aed8-7d8115dca9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a69d1af3-31e2-4d8b-95ac-b742a3c3e4af', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af32437-5ce0-4172-bfd0-405173801fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:17 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Volume volume-a69d1af3-31e2-4d8b-95ac-b742a3c3e4af (a69d1af3-31e2-4d8b-95ac-b742a3c3e4af): created successfully
Sep 22 23:34:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af32437-5ce0-4172-bfd0-405173801fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Flow 'volume_create_manager' (d44b2f13-2c22-4426-98d6-5d8d08e47bd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:34:17 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-2207acb9-b95a-44a7-80f6-9efbd72ac426 tempest-VolumesTransfersV355Test-884100550 None] Created volume successfully.
Sep 22 23:34:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-268d94c9-dbd5-462f-8077-1493d7e46033 tempest-VolumesTransfersV355Test-931346678 None] Acquiring lock "cinder-a69d1af3-31e2-4d8b-95ac-b742a3c3e4af-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:34:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-268d94c9-dbd5-462f-8077-1493d7e46033 tempest-VolumesTransfersV355Test-931346678 None] Lock "cinder-a69d1af3-31e2-4d8b-95ac-b742a3c3e4af-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:34:18 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-268d94c9-dbd5-462f-8077-1493d7e46033 tempest-VolumesTransfersV355Test-931346678 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:34:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-268d94c9-dbd5-462f-8077-1493d7e46033 tempest-VolumesTransfersV355Test-931346678 None] Acquiring lock "cinder-quobyte-a69d1af3-31e2-4d8b-95ac-b742a3c3e4af" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:34:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-268d94c9-dbd5-462f-8077-1493d7e46033 tempest-VolumesTransfersV355Test-931346678 None] Lock "cinder-quobyte-a69d1af3-31e2-4d8b-95ac-b742a3c3e4af" acquired by "delete_volume" :: waited 0.011s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:34:18 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e416eb-2adb-489b-a508-ea00eff4030f]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:34:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-268d94c9-dbd5-462f-8077-1493d7e46033 tempest-VolumesTransfersV355Test-931346678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a69d1af3-31e2-4d8b-95ac-b742a3c3e4af {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:19 devstack quobyte-client[84065]: System call of process 97477 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:34:19 devstack quobyte-client[84065]: System call of process 97477 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:34:19 devstack quobyte-client[84065]: System call of process 97477 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:34:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-268d94c9-dbd5-462f-8077-1493d7e46033 tempest-VolumesTransfersV355Test-931346678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a69d1af3-31e2-4d8b-95ac-b742a3c3e4af" returned: 0 in 0.671s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-268d94c9-dbd5-462f-8077-1493d7e46033 tempest-VolumesTransfersV355Test-931346678 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a69d1af3-31e2-4d8b-95ac-b742a3c3e4af {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-268d94c9-dbd5-462f-8077-1493d7e46033 tempest-VolumesTransfersV355Test-931346678 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a69d1af3-31e2-4d8b-95ac-b742a3c3e4af" returned: 0 in 0.208s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:19 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-268d94c9-dbd5-462f-8077-1493d7e46033 tempest-VolumesTransfersV355Test-931346678 None] Lock "cinder-quobyte-a69d1af3-31e2-4d8b-95ac-b742a3c3e4af" released by "delete_volume" :: held 1.070s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:34:20 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-268d94c9-dbd5-462f-8077-1493d7e46033 tempest-VolumesTransfersV355Test-931346678 None] Created reservations ['484bdd4f-5166-428c-96b4-891ab0c24c7b', '82a98221-a49d-4112-b882-51b5a79119b5', '8d768a79-6c0a-459e-af7f-395ee51d356c', 'ea968c0c-e121-40f6-8f96-136449f33d69'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:34:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-268d94c9-dbd5-462f-8077-1493d7e46033 tempest-VolumesTransfersV355Test-931346678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:34:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-268d94c9-dbd5-462f-8077-1493d7e46033 tempest-VolumesTransfersV355Test-931346678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:34:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-268d94c9-dbd5-462f-8077-1493d7e46033 tempest-VolumesTransfersV355Test-931346678 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:34:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-268d94c9-dbd5-462f-8077-1493d7e46033 tempest-VolumesTransfersV355Test-931346678 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:34:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-268d94c9-dbd5-462f-8077-1493d7e46033 tempest-VolumesTransfersV355Test-931346678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:34:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-268d94c9-dbd5-462f-8077-1493d7e46033 tempest-VolumesTransfersV355Test-931346678 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-268d94c9-dbd5-462f-8077-1493d7e46033 tempest-VolumesTransfersV355Test-931346678 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.114s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:20 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-268d94c9-dbd5-462f-8077-1493d7e46033 tempest-VolumesTransfersV355Test-931346678 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:34:20 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-268d94c9-dbd5-462f-8077-1493d7e46033 tempest-VolumesTransfersV355Test-931346678 None] Deleted volume successfully.
Sep 22 23:34:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-268d94c9-dbd5-462f-8077-1493d7e46033 tempest-VolumesTransfersV355Test-931346678 None] Lock "cinder-a69d1af3-31e2-4d8b-95ac-b742a3c3e4af-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:34:29 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Flow 'volume_create_manager' (b2054e47-5538-4169-bd1a-17faef2bb97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4e5b0e0-4af1-4f31-8e0c-e5f0b08f51ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4e5b0e0-4af1-4f31-8e0c-e5f0b08f51ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1509243396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f4b663-2247-4990-ad4e-5146a229330a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a288de9d6846308c6a508d22177c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:34:29Z,use_quota=True,user_id='2ebe1bd3c5f0442baf8055db4bc75dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601c4ebf-abfd-4928-93ba-cee2a0206334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601c4ebf-abfd-4928-93ba-cee2a0206334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d959f361-6aee-4ef2-9a19-08311e359156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d959f361-6aee-4ef2-9a19-08311e359156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12f4b663-2247-4990-ad4e-5146a229330a', 'volume_name': 'volume-12f4b663-2247-4990-ad4e-5146a229330a', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a16af4-e8b2-40db-a154-c6457763b716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a16af4-e8b2-40db-a154-c6457763b716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61fdb93-a53f-4e73-ba10-9b7f7df8c552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:29 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Volume 12f4b663-2247-4990-ad4e-5146a229330a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12f4b663-2247-4990-ad4e-5146a229330a', 'volume_size': 1}
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1509243396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f4b663-2247-4990-ad4e-5146a229330a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a288de9d6846308c6a508d22177c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:34:29Z,use_quota=True,user_id='2ebe1bd3c5f0442baf8055db4bc75dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Creating volume 12f4b663-2247-4990-ad4e-5146a229330a {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:34:29 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-12f4b663-2247-4990-ad4e-5146a229330a 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:29 devstack quobyte-client[84065]: System call of process 97487 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:34:29 devstack quobyte-client[84065]: System call of process 97487 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:34:29 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=101, name=volume-12f4b663-2247-4990-ad4e-5146a229330a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-12f4b663-2247-4990-ad4e-5146a229330a 1073741824" returned: 0 in 0.418s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-12f4b663-2247-4990-ad4e-5146a229330a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-12f4b663-2247-4990-ad4e-5146a229330a" returned: 0 in 0.113s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:30 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] <== create_volume: return (621ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:34:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.636s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:34:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61fdb93-a53f-4e73-ba10-9b7f7df8c552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12f4b663-2247-4990-ad4e-5146a229330a', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d313d70-d4aa-4e2e-a45f-99d57d9eb6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:30 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Volume volume-12f4b663-2247-4990-ad4e-5146a229330a (12f4b663-2247-4990-ad4e-5146a229330a): created successfully
Sep 22 23:34:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d313d70-d4aa-4e2e-a45f-99d57d9eb6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Flow 'volume_create_manager' (b2054e47-5538-4169-bd1a-17faef2bb97d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:34:30 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-332287f4-7f99-47a3-b708-78aef76199a2 tempest-VolumesTransfersV357Test-142480564 None] Created volume successfully.
Sep 22 23:34:32 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-f48f707b-e743-4eff-ae9f-20eca0e18f41 tempest-VolumesTransfersV357Test-580398600 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:34:32 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-f48f707b-e743-4eff-ae9f-20eca0e18f41 tempest-VolumesTransfersV357Test-580398600 None] Transfer volume completed successfully.
Sep 22 23:34:33 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6dacc547-8f4f-4e67-a7bf-6ef378a22a95 tempest-VolumesTransfersV357Test-105198167 None] Acquiring lock "cinder-12f4b663-2247-4990-ad4e-5146a229330a-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:34:34 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6dacc547-8f4f-4e67-a7bf-6ef378a22a95 tempest-VolumesTransfersV357Test-105198167 None] Lock "cinder-12f4b663-2247-4990-ad4e-5146a229330a-delete_volume" acquired by "delete_volume" :: waited 0.259s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:34:34 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-6dacc547-8f4f-4e67-a7bf-6ef378a22a95 tempest-VolumesTransfersV357Test-105198167 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:34:34 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6dacc547-8f4f-4e67-a7bf-6ef378a22a95 tempest-VolumesTransfersV357Test-105198167 None] Acquiring lock "cinder-quobyte-12f4b663-2247-4990-ad4e-5146a229330a" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:34:34 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6dacc547-8f4f-4e67-a7bf-6ef378a22a95 tempest-VolumesTransfersV357Test-105198167 None] Lock "cinder-quobyte-12f4b663-2247-4990-ad4e-5146a229330a" acquired by "delete_volume" :: waited 0.014s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:34:34 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2e8df2-2c55-4b6e-b955-10e15a91463f]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:34:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6dacc547-8f4f-4e67-a7bf-6ef378a22a95 tempest-VolumesTransfersV357Test-105198167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-12f4b663-2247-4990-ad4e-5146a229330a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6dacc547-8f4f-4e67-a7bf-6ef378a22a95 tempest-VolumesTransfersV357Test-105198167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-12f4b663-2247-4990-ad4e-5146a229330a" returned: 0 in 0.523s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6dacc547-8f4f-4e67-a7bf-6ef378a22a95 tempest-VolumesTransfersV357Test-105198167 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-12f4b663-2247-4990-ad4e-5146a229330a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6dacc547-8f4f-4e67-a7bf-6ef378a22a95 tempest-VolumesTransfersV357Test-105198167 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-12f4b663-2247-4990-ad4e-5146a229330a" returned: 0 in 0.119s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:34 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6dacc547-8f4f-4e67-a7bf-6ef378a22a95 tempest-VolumesTransfersV357Test-105198167 None] Lock "cinder-quobyte-12f4b663-2247-4990-ad4e-5146a229330a" released by "delete_volume" :: held 0.856s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:34:35 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-6dacc547-8f4f-4e67-a7bf-6ef378a22a95 tempest-VolumesTransfersV357Test-105198167 None] Created reservations ['aa0d0a84-13c8-49fc-9211-3db0c4a05b1f', 'be93d0ef-661b-4836-84d5-c37453e31b99', '31e5072b-5606-4b73-8b61-4bc712bca4b4', 'd3188714-9f8d-41f5-9a06-e30cef5135bb'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:34:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6dacc547-8f4f-4e67-a7bf-6ef378a22a95 tempest-VolumesTransfersV357Test-105198167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:34:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6dacc547-8f4f-4e67-a7bf-6ef378a22a95 tempest-VolumesTransfersV357Test-105198167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:34:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6dacc547-8f4f-4e67-a7bf-6ef378a22a95 tempest-VolumesTransfersV357Test-105198167 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:34:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6dacc547-8f4f-4e67-a7bf-6ef378a22a95 tempest-VolumesTransfersV357Test-105198167 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:34:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6dacc547-8f4f-4e67-a7bf-6ef378a22a95 tempest-VolumesTransfersV357Test-105198167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:34:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6dacc547-8f4f-4e67-a7bf-6ef378a22a95 tempest-VolumesTransfersV357Test-105198167 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6dacc547-8f4f-4e67-a7bf-6ef378a22a95 tempest-VolumesTransfersV357Test-105198167 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.135s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:35 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-6dacc547-8f4f-4e67-a7bf-6ef378a22a95 tempest-VolumesTransfersV357Test-105198167 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:34:35 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-6dacc547-8f4f-4e67-a7bf-6ef378a22a95 tempest-VolumesTransfersV357Test-105198167 None] Deleted volume successfully.
Sep 22 23:34:36 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-6dacc547-8f4f-4e67-a7bf-6ef378a22a95 tempest-VolumesTransfersV357Test-105198167 None] Lock "cinder-12f4b663-2247-4990-ad4e-5146a229330a-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:34:36 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:34:36 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:34:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Flow 'volume_create_manager' (9f8175e3-ec20-4aab-af7c-5b26c52cb6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:34:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba19ebb-3702-41b3-83d6-782c75368733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba19ebb-3702-41b3-83d6-782c75368733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1408564110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e783a9a-c6eb-4633-9d09-eb2578cb1280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a288de9d6846308c6a508d22177c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:34:37Z,use_quota=True,user_id='2ebe1bd3c5f0442baf8055db4bc75dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c624644b-c4ec-4923-8346-2743f0c1b3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c624644b-c4ec-4923-8346-2743f0c1b3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389842ce-3ebc-42c2-929c-9ee7c71aca27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389842ce-3ebc-42c2-929c-9ee7c71aca27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e783a9a-c6eb-4633-9d09-eb2578cb1280', 'volume_name': 'volume-8e783a9a-c6eb-4633-9d09-eb2578cb1280', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01686cb5-2b38-4c16-a370-9c088c39ff1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01686cb5-2b38-4c16-a370-9c088c39ff1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0aee998-1971-47c7-8f0a-00ab058fad85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:37 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Volume 8e783a9a-c6eb-4633-9d09-eb2578cb1280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e783a9a-c6eb-4633-9d09-eb2578cb1280', 'volume_size': 1}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1408564110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e783a9a-c6eb-4633-9d09-eb2578cb1280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5a288de9d6846308c6a508d22177c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:34:37Z,use_quota=True,user_id='2ebe1bd3c5f0442baf8055db4bc75dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Creating volume 8e783a9a-c6eb-4633-9d09-eb2578cb1280 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:34:37 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8e783a9a-c6eb-4633-9d09-eb2578cb1280 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:37 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=102, name=volume-8e783a9a-c6eb-4633-9d09-eb2578cb1280, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8e783a9a-c6eb-4633-9d09-eb2578cb1280 1073741824" returned: 0 in 0.427s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8e783a9a-c6eb-4633-9d09-eb2578cb1280 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8e783a9a-c6eb-4633-9d09-eb2578cb1280" returned: 0 in 0.106s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] <== create_volume: return (649ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:34:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:34:38 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0aee998-1971-47c7-8f0a-00ab058fad85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e783a9a-c6eb-4633-9d09-eb2578cb1280', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:38 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503e2f10-2f30-4a3d-880b-a895ec14f0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:38 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Volume volume-8e783a9a-c6eb-4633-9d09-eb2578cb1280 (8e783a9a-c6eb-4633-9d09-eb2578cb1280): created successfully
Sep 22 23:34:38 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503e2f10-2f30-4a3d-880b-a895ec14f0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:38 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Flow 'volume_create_manager' (9f8175e3-ec20-4aab-af7c-5b26c52cb6f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:34:38 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-a344956d-5897-44fe-ab70-9a3ee3a65433 tempest-VolumesTransfersV357Test-142480564 None] Created volume successfully.
Sep 22 23:34:39 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8118a048-d458-43b3-989f-81f8f82902e6 tempest-VolumesTransfersV357Test-105198167 None] Acquiring lock "cinder-8e783a9a-c6eb-4633-9d09-eb2578cb1280-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:34:39 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8118a048-d458-43b3-989f-81f8f82902e6 tempest-VolumesTransfersV357Test-105198167 None] Lock "cinder-8e783a9a-c6eb-4633-9d09-eb2578cb1280-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:34:39 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-8118a048-d458-43b3-989f-81f8f82902e6 tempest-VolumesTransfersV357Test-105198167 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:34:39 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8118a048-d458-43b3-989f-81f8f82902e6 tempest-VolumesTransfersV357Test-105198167 None] Acquiring lock "cinder-quobyte-8e783a9a-c6eb-4633-9d09-eb2578cb1280" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:34:39 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8118a048-d458-43b3-989f-81f8f82902e6 tempest-VolumesTransfersV357Test-105198167 None] Lock "cinder-quobyte-8e783a9a-c6eb-4633-9d09-eb2578cb1280" acquired by "delete_volume" :: waited 0.016s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:34:39 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[890f835d-3f35-4be4-a5ca-b0372c098dd2]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:34:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8118a048-d458-43b3-989f-81f8f82902e6 tempest-VolumesTransfersV357Test-105198167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8e783a9a-c6eb-4633-9d09-eb2578cb1280 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:40 devstack quobyte-client[84065]: System call of process 97503 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:34:40 devstack quobyte-client[84065]: System call of process 97503 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:34:40 devstack quobyte-client[84065]: System call of process 97503 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:34:40 devstack quobyte-client[84065]: System call of process 97503 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:34:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8118a048-d458-43b3-989f-81f8f82902e6 tempest-VolumesTransfersV357Test-105198167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8e783a9a-c6eb-4633-9d09-eb2578cb1280" returned: 0 in 0.536s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8118a048-d458-43b3-989f-81f8f82902e6 tempest-VolumesTransfersV357Test-105198167 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8e783a9a-c6eb-4633-9d09-eb2578cb1280 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8118a048-d458-43b3-989f-81f8f82902e6 tempest-VolumesTransfersV357Test-105198167 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8e783a9a-c6eb-4633-9d09-eb2578cb1280" returned: 0 in 0.180s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:40 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8118a048-d458-43b3-989f-81f8f82902e6 tempest-VolumesTransfersV357Test-105198167 None] Lock "cinder-quobyte-8e783a9a-c6eb-4633-9d09-eb2578cb1280" released by "delete_volume" :: held 1.065s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:34:41 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-8118a048-d458-43b3-989f-81f8f82902e6 tempest-VolumesTransfersV357Test-105198167 None] Created reservations ['513a017a-40bf-43a7-8eea-1cd8bf83f816', '27a84432-08b5-4876-ba3b-5a4ab4b62ea3', '72795712-1619-45e2-a16b-ff1f6054bf82', 'd117b541-e06d-4c47-ac9b-5c2f3d34b49a'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:34:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8118a048-d458-43b3-989f-81f8f82902e6 tempest-VolumesTransfersV357Test-105198167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:34:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8118a048-d458-43b3-989f-81f8f82902e6 tempest-VolumesTransfersV357Test-105198167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:34:41 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-8118a048-d458-43b3-989f-81f8f82902e6 tempest-VolumesTransfersV357Test-105198167 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:34:41 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-8118a048-d458-43b3-989f-81f8f82902e6 tempest-VolumesTransfersV357Test-105198167 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:34:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8118a048-d458-43b3-989f-81f8f82902e6 tempest-VolumesTransfersV357Test-105198167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:34:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8118a048-d458-43b3-989f-81f8f82902e6 tempest-VolumesTransfersV357Test-105198167 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8118a048-d458-43b3-989f-81f8f82902e6 tempest-VolumesTransfersV357Test-105198167 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.167s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:41 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-8118a048-d458-43b3-989f-81f8f82902e6 tempest-VolumesTransfersV357Test-105198167 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:34:41 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-8118a048-d458-43b3-989f-81f8f82902e6 tempest-VolumesTransfersV357Test-105198167 None] Deleted volume successfully.
Sep 22 23:34:42 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8118a048-d458-43b3-989f-81f8f82902e6 tempest-VolumesTransfersV357Test-105198167 None] Lock "cinder-8e783a9a-c6eb-4633-9d09-eb2578cb1280-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:34:43 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Flow 'volume_create_manager' (ca6c9043-9787-4db0-a48e-fa6332368623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0385403a-cd62-4d56-8bc4-079831f934ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0385403a-cd62-4d56-8bc4-079831f934ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-664555080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c96e58a-59e1-4e69-8ef0-36775a298f98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e67f332814f549b49e70d8fc87c7b4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:34:44Z,use_quota=True,user_id='ee636769e04548efa584f584862d5229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f927f18-ecbc-4dd1-a4d9-e304811a43fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f927f18-ecbc-4dd1-a4d9-e304811a43fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c2e2fd-9dfc-437b-a71f-dacf80a2e9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c2e2fd-9dfc-437b-a71f-dacf80a2e9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c96e58a-59e1-4e69-8ef0-36775a298f98', 'volume_name': 'volume-0c96e58a-59e1-4e69-8ef0-36775a298f98', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989c8ed4-15ac-47ed-997a-48ede32a97d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989c8ed4-15ac-47ed-997a-48ede32a97d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df9f768-c0e2-4e06-8631-1574f7047b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:43 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Volume 0c96e58a-59e1-4e69-8ef0-36775a298f98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c96e58a-59e1-4e69-8ef0-36775a298f98', 'volume_size': 1}
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-664555080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c96e58a-59e1-4e69-8ef0-36775a298f98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e67f332814f549b49e70d8fc87c7b4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:34:44Z,use_quota=True,user_id='ee636769e04548efa584f584862d5229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Creating volume 0c96e58a-59e1-4e69-8ef0-36775a298f98 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:34:43 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:34:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0c96e58a-59e1-4e69-8ef0-36775a298f98 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:44 devstack quobyte-client[84065]: System call of process 97540 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:34:44 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=103, name=volume-0c96e58a-59e1-4e69-8ef0-36775a298f98, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:34:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0c96e58a-59e1-4e69-8ef0-36775a298f98 1073741824" returned: 0 in 0.385s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0c96e58a-59e1-4e69-8ef0-36775a298f98 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0c96e58a-59e1-4e69-8ef0-36775a298f98" returned: 0 in 0.137s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:44 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] <== create_volume: return (620ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:34:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.633s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:34:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df9f768-c0e2-4e06-8631-1574f7047b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c96e58a-59e1-4e69-8ef0-36775a298f98', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b605bff2-3c70-4369-86f4-201b0b9419d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:34:44 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Volume volume-0c96e58a-59e1-4e69-8ef0-36775a298f98 (0c96e58a-59e1-4e69-8ef0-36775a298f98): created successfully
Sep 22 23:34:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b605bff2-3c70-4369-86f4-201b0b9419d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:34:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Flow 'volume_create_manager' (ca6c9043-9787-4db0-a48e-fa6332368623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:34:44 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-1872530a-1a32-45e3-a7f8-99abc1eb6304 tempest-VolumesServicesTestJSON-1273110362 None] Created volume successfully.
Sep 22 23:34:46 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-7637b12b-3d7b-4fd0-adb7-d7ab15933042 tempest-VolumesServicesTestJSON-1273110362 None] Acquiring lock "cinder-0c96e58a-59e1-4e69-8ef0-36775a298f98-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:34:46 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-7637b12b-3d7b-4fd0-adb7-d7ab15933042 tempest-VolumesServicesTestJSON-1273110362 None] Lock "cinder-0c96e58a-59e1-4e69-8ef0-36775a298f98-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:34:46 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-7637b12b-3d7b-4fd0-adb7-d7ab15933042 tempest-VolumesServicesTestJSON-1273110362 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:34:46 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-7637b12b-3d7b-4fd0-adb7-d7ab15933042 tempest-VolumesServicesTestJSON-1273110362 None] Acquiring lock "cinder-quobyte-0c96e58a-59e1-4e69-8ef0-36775a298f98" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:34:46 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-7637b12b-3d7b-4fd0-adb7-d7ab15933042 tempest-VolumesServicesTestJSON-1273110362 None] Lock "cinder-quobyte-0c96e58a-59e1-4e69-8ef0-36775a298f98" acquired by "delete_volume" :: waited 0.013s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:34:46 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0266075c-4282-4e88-9743-055b04e96b7d]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:34:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7637b12b-3d7b-4fd0-adb7-d7ab15933042 tempest-VolumesServicesTestJSON-1273110362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0c96e58a-59e1-4e69-8ef0-36775a298f98 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7637b12b-3d7b-4fd0-adb7-d7ab15933042 tempest-VolumesServicesTestJSON-1273110362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0c96e58a-59e1-4e69-8ef0-36775a298f98" returned: 0 in 0.523s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7637b12b-3d7b-4fd0-adb7-d7ab15933042 tempest-VolumesServicesTestJSON-1273110362 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0c96e58a-59e1-4e69-8ef0-36775a298f98 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7637b12b-3d7b-4fd0-adb7-d7ab15933042 tempest-VolumesServicesTestJSON-1273110362 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0c96e58a-59e1-4e69-8ef0-36775a298f98" returned: 0 in 0.106s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:47 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-7637b12b-3d7b-4fd0-adb7-d7ab15933042 tempest-VolumesServicesTestJSON-1273110362 None] Lock "cinder-quobyte-0c96e58a-59e1-4e69-8ef0-36775a298f98" released by "delete_volume" :: held 0.816s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:34:47 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-7637b12b-3d7b-4fd0-adb7-d7ab15933042 tempest-VolumesServicesTestJSON-1273110362 None] Created reservations ['f22e0355-611a-4409-9cff-ef9a05afa3b4', 'dc521c7d-2b6b-48e1-ad55-55e8fa267d37', '567d4f54-ba5c-460f-8eb7-bf023a592453', '18942fa8-2922-440a-b881-d0c1c01f0725'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:34:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-7637b12b-3d7b-4fd0-adb7-d7ab15933042 tempest-VolumesServicesTestJSON-1273110362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:34:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-7637b12b-3d7b-4fd0-adb7-d7ab15933042 tempest-VolumesServicesTestJSON-1273110362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:34:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-7637b12b-3d7b-4fd0-adb7-d7ab15933042 tempest-VolumesServicesTestJSON-1273110362 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:34:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-7637b12b-3d7b-4fd0-adb7-d7ab15933042 tempest-VolumesServicesTestJSON-1273110362 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:34:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-7637b12b-3d7b-4fd0-adb7-d7ab15933042 tempest-VolumesServicesTestJSON-1273110362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:34:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7637b12b-3d7b-4fd0-adb7-d7ab15933042 tempest-VolumesServicesTestJSON-1273110362 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7637b12b-3d7b-4fd0-adb7-d7ab15933042 tempest-VolumesServicesTestJSON-1273110362 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.102s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:47 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-7637b12b-3d7b-4fd0-adb7-d7ab15933042 tempest-VolumesServicesTestJSON-1273110362 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:34:47 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-7637b12b-3d7b-4fd0-adb7-d7ab15933042 tempest-VolumesServicesTestJSON-1273110362 None] Deleted volume successfully.
Sep 22 23:34:48 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:34:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:34:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:34:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:34:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:34:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:34:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:34:48 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-7637b12b-3d7b-4fd0-adb7-d7ab15933042 tempest-VolumesServicesTestJSON-1273110362 None] Lock "cinder-0c96e58a-59e1-4e69-8ef0-36775a298f98-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:34:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.492s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:34:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:34:57 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=59,cinder:UPDATE=97,cinder:INSERT=19,cinder:DELETE=5 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:34:58 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=33,cinder:INSERT=11,cinder:UPDATE=49,cinder:DELETE=6 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:35:05 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Flow 'volume_create_manager' (82020531-0254-4b62-b08d-ce2da47aa15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035babc0-d7c0-4fbf-b439-6474cc2bb4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035babc0-d7c0-4fbf-b439-6474cc2bb4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-612376014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa99777b-e3d3-4d31-9fca-bb1164e39e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a89a2fafe84f4b95c58e656021d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:35:05Z,use_quota=True,user_id='c4446a461d0d45c58016e62f8ae0bc83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe698d8-a177-4e74-9b87-68c2a36e4a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe698d8-a177-4e74-9b87-68c2a36e4a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937f7ed2-d03b-4e33-b7e1-236500ab2867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (937f7ed2-d03b-4e33-b7e1-236500ab2867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa99777b-e3d3-4d31-9fca-bb1164e39e37', 'volume_name': 'volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26bbf1a-6e3e-47f4-a492-78f603f865af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26bbf1a-6e3e-47f4-a492-78f603f865af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361765b8-d1a2-4be6-8710-95855d8b1bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:05 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Volume aa99777b-e3d3-4d31-9fca-bb1164e39e37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37', 'volume_size': 1}
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-612376014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa99777b-e3d3-4d31-9fca-bb1164e39e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a89a2fafe84f4b95c58e656021d058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:35:05Z,use_quota=True,user_id='c4446a461d0d45c58016e62f8ae0bc83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Creating volume aa99777b-e3d3-4d31-9fca-bb1164e39e37 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:35:05 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:35:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:05 devstack quobyte-client[84065]: System call of process 97560 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:35:05 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=104, name=volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:35:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37 1073741824" returned: 0 in 0.472s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37" returned: 0 in 0.109s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:06 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] <== create_volume: return (671ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:35:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:35:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361765b8-d1a2-4be6-8710-95855d8b1bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802f0a91-1990-4232-b7b6-adfb4810c5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:06 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Volume volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37 (aa99777b-e3d3-4d31-9fca-bb1164e39e37): created successfully
Sep 22 23:35:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802f0a91-1990-4232-b7b6-adfb4810c5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Flow 'volume_create_manager' (82020531-0254-4b62-b08d-ce2da47aa15c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:35:06 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-92985611-880b-4b7d-9e52-c99d7d3482f0 tempest-VolumesActionsTest-425497985 None] Created volume successfully.
Sep 22 23:35:09 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Flow 'volume_create_manager' (9670e515-ea3f-47b3-8463-0d28dc124951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99080b66-9760-426e-b1ae-f51c7262c068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99080b66-9760-426e-b1ae-f51c7262c068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-678337108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02231c5c-6eb0-4435-bf9d-d7a7764a9f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724cd1901b3b4a71af8135e3a82615f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:35:09Z,use_quota=True,user_id='0aa450eaae8b47ac833f0d84e99a936f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f149650f-7445-41aa-a2fc-388f20cc914d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f149650f-7445-41aa-a2fc-388f20cc914d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ae37be-0897-4ce8-b242-fe1cccc69858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ae37be-0897-4ce8-b242-fe1cccc69858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02231c5c-6eb0-4435-bf9d-d7a7764a9f1a', 'volume_name': 'volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ed2c4a-a6ae-414c-a1d6-1acee7d7224e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ed2c4a-a6ae-414c-a1d6-1acee7d7224e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66631b1d-b5f2-4b84-8917-f8186de59cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:09 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Volume 02231c5c-6eb0-4435-bf9d-d7a7764a9f1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a', 'volume_size': 1}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-678337108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02231c5c-6eb0-4435-bf9d-d7a7764a9f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724cd1901b3b4a71af8135e3a82615f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:35:09Z,use_quota=True,user_id='0aa450eaae8b47ac833f0d84e99a936f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Creating volume 02231c5c-6eb0-4435-bf9d-d7a7764a9f1a {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:35:09 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:09 devstack quobyte-client[84065]: System call of process 97564 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:35:09 devstack quobyte-client[84065]: System call of process 97564 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:35:09 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=105, name=volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a 1073741824" returned: 0 in 0.399s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a" returned: 0 in 0.115s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] <== create_volume: return (585ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:35:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.599s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:35:10 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66631b1d-b5f2-4b84-8917-f8186de59cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:10 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31977d45-5e8f-466d-91f7-e59f54afca21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:10 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Volume volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a (02231c5c-6eb0-4435-bf9d-d7a7764a9f1a): created successfully
Sep 22 23:35:10 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31977d45-5e8f-466d-91f7-e59f54afca21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:10 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Flow 'volume_create_manager' (9670e515-ea3f-47b3-8463-0d28dc124951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:35:10 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-ccbb9d04-8e25-45a3-84c1-128d3e55212c tempest-SnapshotMetadataTestJSON-1702239882 None] Created volume successfully.
Sep 22 23:35:11 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:35:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:35:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:35:11 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] Creating offline snapshot 1714b235-d3e9-4f22-99bb-27812a5b71a3 of volume 02231c5c-6eb0-4435-bf9d-d7a7764a9f1a {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:35:11 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9f0fa3-b5af-4e58-b3d1-22785cd3ff5d]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:35:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a" returned: 0 in 0.424s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.1714b235-d3e9-4f22-99bb-27812a5b71a3 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:12 devstack quobyte-client[84065]: System call of process 97571 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:35:12 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=106, name=volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.1714b235-d3e9-4f22-99bb-27812a5b71a3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:35:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.1714b235-d3e9-4f22-99bb-27812a5b71a3 1G" returned: 0 in 0.305s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] Running cmd (subprocess): qemu-img rebase -u -b volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.1714b235-d3e9-4f22-99bb-27812a5b71a3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:12 devstack quobyte-client[84065]: System call of process 97574 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:35:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] CMD "qemu-img rebase -u -b volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.1714b235-d3e9-4f22-99bb-27812a5b71a3" returned: 0 in 0.135s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:12 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.1714b235-d3e9-4f22-99bb-27812a5b71a3 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:35:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.1714b235-d3e9-4f22-99bb-27812a5b71a3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.1714b235-d3e9-4f22-99bb-27812a5b71a3" returned: 0 in 0.105s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:12 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:35:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.1714b235-d3e9-4f22-99bb-27812a5b71a3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.1714b235-d3e9-4f22-99bb-27812a5b71a3" returned: 0 in 0.108s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.info" returned: 0 in 0.088s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:13 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.info is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:35:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.info" returned: 0 in 0.090s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.605s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:35:13 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-35255829-916b-4157-9f84-76519f00b908 tempest-SnapshotMetadataTestJSON-1702239882 None] Create snapshot completed successfully
Sep 22 23:35:14 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] Acquiring lock "cinder-1714b235-d3e9-4f22-99bb-27812a5b71a3-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:35:14 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] Lock "cinder-1714b235-d3e9-4f22-99bb-27812a5b71a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:35:14 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:35:14 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] Acquiring lock "cinder-quobyte-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:35:14 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] Lock "cinder-quobyte-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:35:14 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] Acquiring lock "cinder-quobyte-1714b235-d3e9-4f22-99bb-27812a5b71a3" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:35:14 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] Lock "cinder-quobyte-1714b235-d3e9-4f22-99bb-27812a5b71a3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:35:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] Deleting offline snapshot 1714b235-d3e9-4f22-99bb-27812a5b71a3 of volume 02231c5c-6eb0-4435-bf9d-d7a7764a9f1a {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:35:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] snapshot_file for this snap is: volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.1714b235-d3e9-4f22-99bb-27812a5b71a3 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:35:14 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f615e23b-f427-42cf-9d6c-84a1e467b2d1]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:35:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.1714b235-d3e9-4f22-99bb-27812a5b71a3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:15 devstack quobyte-client[84065]: System call of process 97581 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:35:15 devstack quobyte-client[84065]: System call of process 97581 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:35:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.1714b235-d3e9-4f22-99bb-27812a5b71a3" returned: 0 in 0.460s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:15 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:35:15 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cea12d-694a-4462-b58d-d0df1f8845e4]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:35:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a" returned: 0 in 0.602s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.1714b235-d3e9-4f22-99bb-27812a5b71a3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:16 devstack quobyte-client[84065]: System call of process 97588 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:35:16 devstack quobyte-client[84065]: System call of process 97588 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:35:16 devstack quobyte-client[84065]: System call of process 97588 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:35:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.1714b235-d3e9-4f22-99bb-27812a5b71a3" returned: 0 in 0.305s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.1714b235-d3e9-4f22-99bb-27812a5b71a3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a.1714b235-d3e9-4f22-99bb-27812a5b71a3" returned: 0 in 0.153s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:16 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] Lock "cinder-quobyte-1714b235-d3e9-4f22-99bb-27812a5b71a3" released by "_delete_snapshot" :: held 1.997s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:35:16 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] Lock "cinder-quobyte-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a" released by "delete_snapshot" :: held 2.029s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:35:17 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] Created reservations ['6dae34d0-f622-49fd-8164-191af463892c', '22dc8d63-2ebb-49c7-9a82-453f5c20a050', '502a1fd6-0ab2-43de-a97b-d9ca0e1e19c8', 'dda32aa3-89d9-4d93-82ac-456e481c2a8a'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:35:17 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] Delete snapshot completed successfully.
Sep 22 23:35:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4b44946d-4905-49a4-9669-326b61e0b2c5 tempest-SnapshotMetadataTestJSON-1702239882 None] Lock "cinder-1714b235-d3e9-4f22-99bb-27812a5b71a3-delete_snapshot" released by "delete_snapshot" :: held 2.762s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:35:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-fd93701d-e77d-421f-9471-fbccb3af7952 tempest-SnapshotMetadataTestJSON-1702239882 None] Acquiring lock "cinder-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:35:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-fd93701d-e77d-421f-9471-fbccb3af7952 tempest-SnapshotMetadataTestJSON-1702239882 None] Lock "cinder-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:35:18 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-fd93701d-e77d-421f-9471-fbccb3af7952 tempest-SnapshotMetadataTestJSON-1702239882 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:35:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-fd93701d-e77d-421f-9471-fbccb3af7952 tempest-SnapshotMetadataTestJSON-1702239882 None] Acquiring lock "cinder-quobyte-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:35:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-fd93701d-e77d-421f-9471-fbccb3af7952 tempest-SnapshotMetadataTestJSON-1702239882 None] Lock "cinder-quobyte-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a" acquired by "delete_volume" :: waited 0.021s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:35:18 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cd57bb-e33d-4e98-a437-194e4c14cc42]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:35:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fd93701d-e77d-421f-9471-fbccb3af7952 tempest-SnapshotMetadataTestJSON-1702239882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:18 devstack quobyte-client[84065]: System call of process 97603 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:35:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fd93701d-e77d-421f-9471-fbccb3af7952 tempest-SnapshotMetadataTestJSON-1702239882 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a" returned: 0 in 0.645s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fd93701d-e77d-421f-9471-fbccb3af7952 tempest-SnapshotMetadataTestJSON-1702239882 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fd93701d-e77d-421f-9471-fbccb3af7952 tempest-SnapshotMetadataTestJSON-1702239882 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a" returned: 0 in 0.199s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:19 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-fd93701d-e77d-421f-9471-fbccb3af7952 tempest-SnapshotMetadataTestJSON-1702239882 None] Lock "cinder-quobyte-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a" released by "delete_volume" :: held 1.106s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:35:19 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-fd93701d-e77d-421f-9471-fbccb3af7952 tempest-SnapshotMetadataTestJSON-1702239882 None] Created reservations ['aa2e8a49-4256-421d-94e7-46ef43b849d3', '4403a7a6-f41b-4b55-a69c-ade81159a7e3', 'af1e4f50-4bc2-49b1-97ec-42195d2dbbd3', '84672465-9ea6-4847-83c1-ecfe184385cf'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:35:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fd93701d-e77d-421f-9471-fbccb3af7952 tempest-SnapshotMetadataTestJSON-1702239882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:35:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fd93701d-e77d-421f-9471-fbccb3af7952 tempest-SnapshotMetadataTestJSON-1702239882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:35:19 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fd93701d-e77d-421f-9471-fbccb3af7952 tempest-SnapshotMetadataTestJSON-1702239882 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:35:19 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fd93701d-e77d-421f-9471-fbccb3af7952 tempest-SnapshotMetadataTestJSON-1702239882 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:35:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fd93701d-e77d-421f-9471-fbccb3af7952 tempest-SnapshotMetadataTestJSON-1702239882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:35:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fd93701d-e77d-421f-9471-fbccb3af7952 tempest-SnapshotMetadataTestJSON-1702239882 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fd93701d-e77d-421f-9471-fbccb3af7952 tempest-SnapshotMetadataTestJSON-1702239882 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.103s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:19 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-fd93701d-e77d-421f-9471-fbccb3af7952 tempest-SnapshotMetadataTestJSON-1702239882 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:35:20 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-fd93701d-e77d-421f-9471-fbccb3af7952 tempest-SnapshotMetadataTestJSON-1702239882 None] Deleted volume successfully.
Sep 22 23:35:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-fd93701d-e77d-421f-9471-fbccb3af7952 tempest-SnapshotMetadataTestJSON-1702239882 None] Lock "cinder-02231c5c-6eb0-4435-bf9d-d7a7764a9f1a-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:35:29 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Flow 'volume_create_manager' (2128f40e-66cf-45fc-ab15-2079cf7cd86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ddb059-eac1-4447-bb8e-62b8599afda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ddb059-eac1-4447-bb8e-62b8599afda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1316701601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc1b933-fad6-4da2-a844-2902be4985eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cbf315a35ba4bbbaab3c2b388f5221c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:35:29Z,use_quota=True,user_id='338e80787d33463e8b2036adeeb07120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b599499-c178-43f8-bf69-df8d2d25819c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b599499-c178-43f8-bf69-df8d2d25819c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ddbf42f-92dd-4a05-9089-cf8ebc9d2192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ddbf42f-92dd-4a05-9089-cf8ebc9d2192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dc1b933-fad6-4da2-a844-2902be4985eb', 'volume_name': 'volume-6dc1b933-fad6-4da2-a844-2902be4985eb', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ea73bb-c117-40fd-8bb6-8ae6ad1b4f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ea73bb-c117-40fd-8bb6-8ae6ad1b4f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3641be-5a33-4589-94d5-0e097762f757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:29 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Volume 6dc1b933-fad6-4da2-a844-2902be4985eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dc1b933-fad6-4da2-a844-2902be4985eb', 'volume_size': 1}
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1316701601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc1b933-fad6-4da2-a844-2902be4985eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cbf315a35ba4bbbaab3c2b388f5221c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:35:29Z,use_quota=True,user_id='338e80787d33463e8b2036adeeb07120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Creating volume 6dc1b933-fad6-4da2-a844-2902be4985eb {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:35:29 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:35:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6dc1b933-fad6-4da2-a844-2902be4985eb 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:29 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=108, name=volume-6dc1b933-fad6-4da2-a844-2902be4985eb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:35:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6dc1b933-fad6-4da2-a844-2902be4985eb 1073741824" returned: 0 in 0.542s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6dc1b933-fad6-4da2-a844-2902be4985eb {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6dc1b933-fad6-4da2-a844-2902be4985eb" returned: 0 in 0.192s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:30 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] <== create_volume: return (858ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:35:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:35:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3641be-5a33-4589-94d5-0e097762f757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dc1b933-fad6-4da2-a844-2902be4985eb', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18671ab4-8e19-4e2d-91b7-b1e3a2ed1d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:30 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Volume volume-6dc1b933-fad6-4da2-a844-2902be4985eb (6dc1b933-fad6-4da2-a844-2902be4985eb): created successfully
Sep 22 23:35:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18671ab4-8e19-4e2d-91b7-b1e3a2ed1d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:30 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Flow 'volume_create_manager' (2128f40e-66cf-45fc-ab15-2079cf7cd86b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:35:31 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-f616a25c-4eae-4760-aac3-9a9b6840421e tempest-AbsoluteLimitsTests-659854066 None] Created volume successfully.
Sep 22 23:35:31 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d7b9315d-f78a-4784-9a45-ead88c128890 tempest-AbsoluteLimitsTests-659854066 None] Acquiring lock "cinder-6dc1b933-fad6-4da2-a844-2902be4985eb-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:35:31 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d7b9315d-f78a-4784-9a45-ead88c128890 tempest-AbsoluteLimitsTests-659854066 None] Lock "cinder-6dc1b933-fad6-4da2-a844-2902be4985eb-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:35:31 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-d7b9315d-f78a-4784-9a45-ead88c128890 tempest-AbsoluteLimitsTests-659854066 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:35:31 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d7b9315d-f78a-4784-9a45-ead88c128890 tempest-AbsoluteLimitsTests-659854066 None] Acquiring lock "cinder-quobyte-6dc1b933-fad6-4da2-a844-2902be4985eb" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:35:31 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d7b9315d-f78a-4784-9a45-ead88c128890 tempest-AbsoluteLimitsTests-659854066 None] Lock "cinder-quobyte-6dc1b933-fad6-4da2-a844-2902be4985eb" acquired by "delete_volume" :: waited 0.020s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:35:31 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f5882d-b370-42ec-ab13-aa6ccf21cd50]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:35:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d7b9315d-f78a-4784-9a45-ead88c128890 tempest-AbsoluteLimitsTests-659854066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6dc1b933-fad6-4da2-a844-2902be4985eb {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d7b9315d-f78a-4784-9a45-ead88c128890 tempest-AbsoluteLimitsTests-659854066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6dc1b933-fad6-4da2-a844-2902be4985eb" returned: 0 in 0.523s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d7b9315d-f78a-4784-9a45-ead88c128890 tempest-AbsoluteLimitsTests-659854066 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6dc1b933-fad6-4da2-a844-2902be4985eb {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d7b9315d-f78a-4784-9a45-ead88c128890 tempest-AbsoluteLimitsTests-659854066 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6dc1b933-fad6-4da2-a844-2902be4985eb" returned: 0 in 0.094s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:32 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d7b9315d-f78a-4784-9a45-ead88c128890 tempest-AbsoluteLimitsTests-659854066 None] Lock "cinder-quobyte-6dc1b933-fad6-4da2-a844-2902be4985eb" released by "delete_volume" :: held 0.824s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:35:32 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-d7b9315d-f78a-4784-9a45-ead88c128890 tempest-AbsoluteLimitsTests-659854066 None] Created reservations ['9b7aae69-19ea-43b2-a97a-1b1014d576dc', '93310136-1008-49ad-8f3d-da677a4878d0', 'f929ff5c-76a5-4b50-afc2-ef9ab49caa04', 'de5f1e93-ef57-4551-bb53-ee2101610dc9'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:35:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d7b9315d-f78a-4784-9a45-ead88c128890 tempest-AbsoluteLimitsTests-659854066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:35:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d7b9315d-f78a-4784-9a45-ead88c128890 tempest-AbsoluteLimitsTests-659854066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:35:32 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d7b9315d-f78a-4784-9a45-ead88c128890 tempest-AbsoluteLimitsTests-659854066 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:35:32 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d7b9315d-f78a-4784-9a45-ead88c128890 tempest-AbsoluteLimitsTests-659854066 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:35:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d7b9315d-f78a-4784-9a45-ead88c128890 tempest-AbsoluteLimitsTests-659854066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:35:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d7b9315d-f78a-4784-9a45-ead88c128890 tempest-AbsoluteLimitsTests-659854066 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d7b9315d-f78a-4784-9a45-ead88c128890 tempest-AbsoluteLimitsTests-659854066 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.105s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:33 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-d7b9315d-f78a-4784-9a45-ead88c128890 tempest-AbsoluteLimitsTests-659854066 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:35:33 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-d7b9315d-f78a-4784-9a45-ead88c128890 tempest-AbsoluteLimitsTests-659854066 None] Deleted volume successfully.
Sep 22 23:35:33 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d7b9315d-f78a-4784-9a45-ead88c128890 tempest-AbsoluteLimitsTests-659854066 None] Lock "cinder-6dc1b933-fad6-4da2-a844-2902be4985eb-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:35:36 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-22637aaf-d584-46e3-8b61-4c0e9138bf65 tempest-VolumesActionsTest-425497985 None] Acquiring lock "cinder-aa99777b-e3d3-4d31-9fca-bb1164e39e37" by "attach_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:35:36 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-22637aaf-d584-46e3-8b61-4c0e9138bf65 tempest-VolumesActionsTest-425497985 None] Lock "cinder-aa99777b-e3d3-4d31-9fca-bb1164e39e37" acquired by "attach_volume" :: waited 0.033s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:35:37 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-22637aaf-d584-46e3-8b61-4c0e9138bf65 tempest-VolumesActionsTest-425497985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:35:37 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-22637aaf-d584-46e3-8b61-4c0e9138bf65 tempest-VolumesActionsTest-425497985 None] Attaching volume aa99777b-e3d3-4d31-9fca-bb1164e39e37 to instance 02130a34-b29a-425d-9fef-f8a0bacf1d4c at mountpoint /dev/vdb on host None.
Sep 22 23:35:37 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-22637aaf-d584-46e3-8b61-4c0e9138bf65 tempest-VolumesActionsTest-425497985 None] Attach volume completed successfully.
Sep 22 23:35:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-22637aaf-d584-46e3-8b61-4c0e9138bf65 tempest-VolumesActionsTest-425497985 None] Lock "cinder-aa99777b-e3d3-4d31-9fca-bb1164e39e37" released by "attach_volume" :: held 0.574s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:35:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-92094ec9-fe4a-4b16-bff8-93f7307bad5f tempest-VolumesActionsTest-425497985 None] Acquiring lock "cinder-aa99777b-e3d3-4d31-9fca-bb1164e39e37-detach_volume" by "detach_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:35:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-92094ec9-fe4a-4b16-bff8-93f7307bad5f tempest-VolumesActionsTest-425497985 None] Lock "cinder-aa99777b-e3d3-4d31-9fca-bb1164e39e37-detach_volume" acquired by "detach_volume" :: waited 0.079s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:35:37 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-92094ec9-fe4a-4b16-bff8-93f7307bad5f tempest-VolumesActionsTest-425497985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:35:37 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-92094ec9-fe4a-4b16-bff8-93f7307bad5f tempest-VolumesActionsTest-425497985 None] Detaching volume aa99777b-e3d3-4d31-9fca-bb1164e39e37 from instance 02130a34-b29a-425d-9fef-f8a0bacf1d4c.
Sep 22 23:35:37 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-92094ec9-fe4a-4b16-bff8-93f7307bad5f tempest-VolumesActionsTest-425497985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:35:38 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-92094ec9-fe4a-4b16-bff8-93f7307bad5f tempest-VolumesActionsTest-425497985 None] Detach volume completed successfully.
Sep 22 23:35:38 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-92094ec9-fe4a-4b16-bff8-93f7307bad5f tempest-VolumesActionsTest-425497985 None] Lock "cinder-aa99777b-e3d3-4d31-9fca-bb1164e39e37-detach_volume" released by "detach_volume" :: held 0.141s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:35:41 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:35:41 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Flow 'volume_create_manager' (a4cd5bcd-9611-49f6-8fb8-9c1256127036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0175f8-631d-40de-9ed3-8278e27107c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0175f8-631d-40de-9ed3-8278e27107c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1276036357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9fe5173-c242-475f-8532-e638db324b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31f0b383fc8497f876e5b22e5731efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:35:42Z,use_quota=True,user_id='3f9e7f7e7c8c43c28696a90de65650e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef69b54-3c8d-4d3b-bc28-f8c41d5e4083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef69b54-3c8d-4d3b-bc28-f8c41d5e4083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012d91dd-c0b1-4b98-8112-8eb7b7d00d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012d91dd-c0b1-4b98-8112-8eb7b7d00d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9fe5173-c242-475f-8532-e638db324b99', 'volume_name': 'volume-d9fe5173-c242-475f-8532-e638db324b99', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd266dcb-0aec-4aee-8b40-4981d4d74db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd266dcb-0aec-4aee-8b40-4981d4d74db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48823df5-755e-41ae-9b5d-3094a3bcf55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:42 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Volume d9fe5173-c242-475f-8532-e638db324b99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9fe5173-c242-475f-8532-e638db324b99', 'volume_size': 1}
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1276036357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9fe5173-c242-475f-8532-e638db324b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b31f0b383fc8497f876e5b22e5731efd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:35:42Z,use_quota=True,user_id='3f9e7f7e7c8c43c28696a90de65650e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Creating volume d9fe5173-c242-475f-8532-e638db324b99 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:35:42 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d9fe5173-c242-475f-8532-e638db324b99 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:42 devstack quobyte-client[84065]: System call of process 97783 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:35:42 devstack quobyte-client[84065]: System call of process 97783 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:35:42 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=109, name=volume-d9fe5173-c242-475f-8532-e638db324b99, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d9fe5173-c242-475f-8532-e638db324b99 1073741824" returned: 0 in 0.559s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d9fe5173-c242-475f-8532-e638db324b99 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d9fe5173-c242-475f-8532-e638db324b99" returned: 0 in 0.182s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] <== create_volume: return (863ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:35:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:35:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48823df5-755e-41ae-9b5d-3094a3bcf55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9fe5173-c242-475f-8532-e638db324b99', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb66d0b4-4d10-43b9-b9f3-15099e138f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:43 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Volume volume-d9fe5173-c242-475f-8532-e638db324b99 (d9fe5173-c242-475f-8532-e638db324b99): created successfully
Sep 22 23:35:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb66d0b4-4d10-43b9-b9f3-15099e138f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Flow 'volume_create_manager' (a4cd5bcd-9611-49f6-8fb8-9c1256127036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:35:43 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-cb18199f-b56b-43d5-b860-119f3d883481 tempest-VolumesMetadataTest-309727044 None] Created volume successfully.
Sep 22 23:35:45 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-344c494d-e695-4faf-ac7d-d3c19ef9f835 tempest-VolumesMetadataTest-309727044 None] Acquiring lock "cinder-d9fe5173-c242-475f-8532-e638db324b99-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:35:45 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-344c494d-e695-4faf-ac7d-d3c19ef9f835 tempest-VolumesMetadataTest-309727044 None] Lock "cinder-d9fe5173-c242-475f-8532-e638db324b99-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:35:45 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-344c494d-e695-4faf-ac7d-d3c19ef9f835 tempest-VolumesMetadataTest-309727044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:35:45 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-344c494d-e695-4faf-ac7d-d3c19ef9f835 tempest-VolumesMetadataTest-309727044 None] Acquiring lock "cinder-quobyte-d9fe5173-c242-475f-8532-e638db324b99" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:35:45 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-344c494d-e695-4faf-ac7d-d3c19ef9f835 tempest-VolumesMetadataTest-309727044 None] Lock "cinder-quobyte-d9fe5173-c242-475f-8532-e638db324b99" acquired by "delete_volume" :: waited 0.019s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:35:45 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[49415a79-488d-4361-8ced-2bcb02de1167]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:35:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-344c494d-e695-4faf-ac7d-d3c19ef9f835 tempest-VolumesMetadataTest-309727044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d9fe5173-c242-475f-8532-e638db324b99 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:45 devstack quobyte-client[84065]: System call of process 97791 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:35:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-344c494d-e695-4faf-ac7d-d3c19ef9f835 tempest-VolumesMetadataTest-309727044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d9fe5173-c242-475f-8532-e638db324b99" returned: 0 in 0.428s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-344c494d-e695-4faf-ac7d-d3c19ef9f835 tempest-VolumesMetadataTest-309727044 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d9fe5173-c242-475f-8532-e638db324b99 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-344c494d-e695-4faf-ac7d-d3c19ef9f835 tempest-VolumesMetadataTest-309727044 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d9fe5173-c242-475f-8532-e638db324b99" returned: 0 in 0.102s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:46 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-344c494d-e695-4faf-ac7d-d3c19ef9f835 tempest-VolumesMetadataTest-309727044 None] Lock "cinder-quobyte-d9fe5173-c242-475f-8532-e638db324b99" released by "delete_volume" :: held 0.716s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:35:46 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-344c494d-e695-4faf-ac7d-d3c19ef9f835 tempest-VolumesMetadataTest-309727044 None] Created reservations ['48ceaf34-5fd9-4b32-a8ba-66824302d42c', 'afc37554-fb27-4f87-b9e5-690a38a22a67', '79d5b190-1ee7-47c1-a8a3-1515e8420b9e', '6b0c3e89-9e6d-4085-84a5-f5fac5e5f0e5'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:35:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-344c494d-e695-4faf-ac7d-d3c19ef9f835 tempest-VolumesMetadataTest-309727044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:35:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-344c494d-e695-4faf-ac7d-d3c19ef9f835 tempest-VolumesMetadataTest-309727044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:35:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-344c494d-e695-4faf-ac7d-d3c19ef9f835 tempest-VolumesMetadataTest-309727044 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:35:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-344c494d-e695-4faf-ac7d-d3c19ef9f835 tempest-VolumesMetadataTest-309727044 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:35:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-344c494d-e695-4faf-ac7d-d3c19ef9f835 tempest-VolumesMetadataTest-309727044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:35:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-344c494d-e695-4faf-ac7d-d3c19ef9f835 tempest-VolumesMetadataTest-309727044 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-344c494d-e695-4faf-ac7d-d3c19ef9f835 tempest-VolumesMetadataTest-309727044 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.085s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:46 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-344c494d-e695-4faf-ac7d-d3c19ef9f835 tempest-VolumesMetadataTest-309727044 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:35:46 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-344c494d-e695-4faf-ac7d-d3c19ef9f835 tempest-VolumesMetadataTest-309727044 None] Deleted volume successfully.
Sep 22 23:35:47 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-344c494d-e695-4faf-ac7d-d3c19ef9f835 tempest-VolumesMetadataTest-309727044 None] Lock "cinder-d9fe5173-c242-475f-8532-e638db324b99-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:35:48 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:35:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:35:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:35:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:35:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:35:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:35:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.157s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:35:51 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Flow 'volume_create_manager' (882768a6-48ab-45f6-8c42-6ced8e44aeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe175dd3-d245-40bb-8d7d-2f40e25c79a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe175dd3-d245-40bb-8d7d-2f40e25c79a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1048507541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c171fd9-6324-4e20-9c21-d9c3c46267d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='578cbf47b22042c189412ae5a1ec81e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:35:51Z,use_quota=True,user_id='01c888cd581243dcba3f85f5dfd6a827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061635b1-0db7-4a90-864c-cd107e2683e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061635b1-0db7-4a90-864c-cd107e2683e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05822b54-6689-4dc4-8874-628e84dd39bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05822b54-6689-4dc4-8874-628e84dd39bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c171fd9-6324-4e20-9c21-d9c3c46267d9', 'volume_name': 'volume-5c171fd9-6324-4e20-9c21-d9c3c46267d9', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c33b7b5-6c72-4ced-9be0-08a445d69c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c33b7b5-6c72-4ced-9be0-08a445d69c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab66567-8499-4810-b303-e94397c42d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:51 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Volume 5c171fd9-6324-4e20-9c21-d9c3c46267d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c171fd9-6324-4e20-9c21-d9c3c46267d9', 'volume_size': 1}
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1048507541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c171fd9-6324-4e20-9c21-d9c3c46267d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='578cbf47b22042c189412ae5a1ec81e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:35:51Z,use_quota=True,user_id='01c888cd581243dcba3f85f5dfd6a827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Creating volume 5c171fd9-6324-4e20-9c21-d9c3c46267d9 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:35:51 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:35:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5c171fd9-6324-4e20-9c21-d9c3c46267d9 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:51 devstack quobyte-client[84065]: System call of process 97798 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:35:51 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=110, name=volume-5c171fd9-6324-4e20-9c21-d9c3c46267d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:35:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5c171fd9-6324-4e20-9c21-d9c3c46267d9 1073741824" returned: 0 in 0.383s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5c171fd9-6324-4e20-9c21-d9c3c46267d9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5c171fd9-6324-4e20-9c21-d9c3c46267d9" returned: 0 in 0.087s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:52 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] <== create_volume: return (546ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:35:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.559s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:35:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab66567-8499-4810-b303-e94397c42d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c171fd9-6324-4e20-9c21-d9c3c46267d9', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8423f8c6-870f-49f0-891c-f3e51d7ca0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:52 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Volume volume-5c171fd9-6324-4e20-9c21-d9c3c46267d9 (5c171fd9-6324-4e20-9c21-d9c3c46267d9): created successfully
Sep 22 23:35:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8423f8c6-870f-49f0-891c-f3e51d7ca0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Flow 'volume_create_manager' (882768a6-48ab-45f6-8c42-6ced8e44aeff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:35:52 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-8d1924fb-6ce4-4e6f-b26e-80cfcb3c3c7f tempest-VolumesListTestJSON-968897867 None] Created volume successfully.
Sep 22 23:35:53 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:35:53 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:35:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Flow 'volume_create_manager' (168fe479-5dc9-4ce9-ad16-61650a526852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:35:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529581f7-6b31-43bc-a0e7-f26677643b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529581f7-6b31-43bc-a0e7-f26677643b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1524062346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319c0216-e272-480a-bc7e-3fd07c34b975,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='578cbf47b22042c189412ae5a1ec81e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:35:54Z,use_quota=True,user_id='01c888cd581243dcba3f85f5dfd6a827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35183e50-ea24-4b46-87e8-2a77589b481f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35183e50-ea24-4b46-87e8-2a77589b481f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (137bcec2-bd2d-477d-97b7-49157b4aa964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (137bcec2-bd2d-477d-97b7-49157b4aa964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '319c0216-e272-480a-bc7e-3fd07c34b975', 'volume_name': 'volume-319c0216-e272-480a-bc7e-3fd07c34b975', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed349269-1b29-43af-bece-711ee51998fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed349269-1b29-43af-bece-711ee51998fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (981a2b12-51e0-4a9e-b28d-1307386a05b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:54 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Volume 319c0216-e272-480a-bc7e-3fd07c34b975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-319c0216-e272-480a-bc7e-3fd07c34b975', 'volume_size': 1}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1524062346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319c0216-e272-480a-bc7e-3fd07c34b975,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='578cbf47b22042c189412ae5a1ec81e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:35:54Z,use_quota=True,user_id='01c888cd581243dcba3f85f5dfd6a827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Creating volume 319c0216-e272-480a-bc7e-3fd07c34b975 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:35:54 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-319c0216-e272-480a-bc7e-3fd07c34b975 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:54 devstack quobyte-client[84065]: System call of process 97802 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:35:54 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=111, name=volume-319c0216-e272-480a-bc7e-3fd07c34b975, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-319c0216-e272-480a-bc7e-3fd07c34b975 1073741824" returned: 0 in 0.410s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-319c0216-e272-480a-bc7e-3fd07c34b975 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-319c0216-e272-480a-bc7e-3fd07c34b975" returned: 0 in 0.082s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] <== create_volume: return (566ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.577s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (981a2b12-51e0-4a9e-b28d-1307386a05b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-319c0216-e272-480a-bc7e-3fd07c34b975', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb01b591-e8d1-489c-b652-b1308380239b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:54 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Volume volume-319c0216-e272-480a-bc7e-3fd07c34b975 (319c0216-e272-480a-bc7e-3fd07c34b975): created successfully
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb01b591-e8d1-489c-b652-b1308380239b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Flow 'volume_create_manager' (168fe479-5dc9-4ce9-ad16-61650a526852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:35:55 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-fc1e65fb-beab-4ec9-a1ff-52ae1efd124a tempest-VolumesListTestJSON-968897867 None] Created volume successfully.
Sep 22 23:35:56 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Flow 'volume_create_manager' (3e606a05-4af7-4761-b603-e503344d3d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4360f2-c6e7-49ae-8680-765265e59130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4360f2-c6e7-49ae-8680-765265e59130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1106370023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1e08f4-17bb-4478-b002-438a01180e53,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='578cbf47b22042c189412ae5a1ec81e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:35:57Z,use_quota=True,user_id='01c888cd581243dcba3f85f5dfd6a827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fc16ae-3c80-4b34-ac0b-27ea60dc9450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fc16ae-3c80-4b34-ac0b-27ea60dc9450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091cafc2-005e-4be2-93b6-cb9d03beb7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091cafc2-005e-4be2-93b6-cb9d03beb7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c1e08f4-17bb-4478-b002-438a01180e53', 'volume_name': 'volume-9c1e08f4-17bb-4478-b002-438a01180e53', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80731b72-2567-4560-953b-5c56954a656e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80731b72-2567-4560-953b-5c56954a656e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c769b4-199d-45ba-be01-b82089d23004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:56 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Volume 9c1e08f4-17bb-4478-b002-438a01180e53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c1e08f4-17bb-4478-b002-438a01180e53', 'volume_size': 1}
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1106370023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1e08f4-17bb-4478-b002-438a01180e53,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='578cbf47b22042c189412ae5a1ec81e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:35:57Z,use_quota=True,user_id='01c888cd581243dcba3f85f5dfd6a827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Creating volume 9c1e08f4-17bb-4478-b002-438a01180e53 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:35:56 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:35:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9c1e08f4-17bb-4478-b002-438a01180e53 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:57 devstack quobyte-client[84065]: System call of process 97807 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:35:57 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=112, name=volume-9c1e08f4-17bb-4478-b002-438a01180e53, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:35:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9c1e08f4-17bb-4478-b002-438a01180e53 1073741824" returned: 0 in 0.511s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9c1e08f4-17bb-4478-b002-438a01180e53 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:35:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9c1e08f4-17bb-4478-b002-438a01180e53" returned: 0 in 0.199s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:35:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] <== create_volume: return (804ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:35:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:35:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c769b4-199d-45ba-be01-b82089d23004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c1e08f4-17bb-4478-b002-438a01180e53', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b766430-50b9-49c8-86f9-ce548be3dd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:35:58 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=41,cinder:UPDATE=49,cinder:DELETE=4,cinder:INSERT=11 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:35:58 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Volume volume-9c1e08f4-17bb-4478-b002-438a01180e53 (9c1e08f4-17bb-4478-b002-438a01180e53): created successfully
Sep 22 23:35:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b766430-50b9-49c8-86f9-ce548be3dd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:35:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Flow 'volume_create_manager' (3e606a05-4af7-4761-b603-e503344d3d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:35:58 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=46,cinder:DELETE=6,cinder:SELECT=28,cinder:INSERT=7 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:35:58 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-fb06acda-ef61-4485-9f58-793f944d1273 tempest-VolumesListTestJSON-968897867 None] Created volume successfully.
Sep 22 23:36:03 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c874a4ef-dc0b-4bf7-814f-c21eaf127e41 tempest-VolumesListTestJSON-968897867 None] Acquiring lock "cinder-9c1e08f4-17bb-4478-b002-438a01180e53-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:36:03 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c874a4ef-dc0b-4bf7-814f-c21eaf127e41 tempest-VolumesListTestJSON-968897867 None] Lock "cinder-9c1e08f4-17bb-4478-b002-438a01180e53-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:36:04 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-c874a4ef-dc0b-4bf7-814f-c21eaf127e41 tempest-VolumesListTestJSON-968897867 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:36:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c874a4ef-dc0b-4bf7-814f-c21eaf127e41 tempest-VolumesListTestJSON-968897867 None] Acquiring lock "cinder-quobyte-9c1e08f4-17bb-4478-b002-438a01180e53" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:36:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c874a4ef-dc0b-4bf7-814f-c21eaf127e41 tempest-VolumesListTestJSON-968897867 None] Lock "cinder-quobyte-9c1e08f4-17bb-4478-b002-438a01180e53" acquired by "delete_volume" :: waited 0.014s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:36:04 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b27016-c19b-455a-9b70-e0ac0a05a575]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:36:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c874a4ef-dc0b-4bf7-814f-c21eaf127e41 tempest-VolumesListTestJSON-968897867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9c1e08f4-17bb-4478-b002-438a01180e53 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:36:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c874a4ef-dc0b-4bf7-814f-c21eaf127e41 tempest-VolumesListTestJSON-968897867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9c1e08f4-17bb-4478-b002-438a01180e53" returned: 0 in 0.424s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:36:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c874a4ef-dc0b-4bf7-814f-c21eaf127e41 tempest-VolumesListTestJSON-968897867 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9c1e08f4-17bb-4478-b002-438a01180e53 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:36:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c874a4ef-dc0b-4bf7-814f-c21eaf127e41 tempest-VolumesListTestJSON-968897867 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9c1e08f4-17bb-4478-b002-438a01180e53" returned: 0 in 0.099s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:36:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c874a4ef-dc0b-4bf7-814f-c21eaf127e41 tempest-VolumesListTestJSON-968897867 None] Lock "cinder-quobyte-9c1e08f4-17bb-4478-b002-438a01180e53" released by "delete_volume" :: held 0.727s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:36:05 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-c874a4ef-dc0b-4bf7-814f-c21eaf127e41 tempest-VolumesListTestJSON-968897867 None] Created reservations ['a0eccb1d-d1bc-4b21-912c-dfc63190a044', '1b435d39-c4c0-4bb8-aab3-9b8c6be5f23c', 'b53fc3e7-9f67-457a-95ff-7e939751d1fc', 'b24bbf29-08e9-4b25-bc89-7b1b0ad3823e'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:36:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c874a4ef-dc0b-4bf7-814f-c21eaf127e41 tempest-VolumesListTestJSON-968897867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:36:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c874a4ef-dc0b-4bf7-814f-c21eaf127e41 tempest-VolumesListTestJSON-968897867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:36:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c874a4ef-dc0b-4bf7-814f-c21eaf127e41 tempest-VolumesListTestJSON-968897867 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:36:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c874a4ef-dc0b-4bf7-814f-c21eaf127e41 tempest-VolumesListTestJSON-968897867 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:36:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c874a4ef-dc0b-4bf7-814f-c21eaf127e41 tempest-VolumesListTestJSON-968897867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:36:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c874a4ef-dc0b-4bf7-814f-c21eaf127e41 tempest-VolumesListTestJSON-968897867 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:36:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c874a4ef-dc0b-4bf7-814f-c21eaf127e41 tempest-VolumesListTestJSON-968897867 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.081s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:36:05 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-c874a4ef-dc0b-4bf7-814f-c21eaf127e41 tempest-VolumesListTestJSON-968897867 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:36:05 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-c874a4ef-dc0b-4bf7-814f-c21eaf127e41 tempest-VolumesListTestJSON-968897867 None] Deleted volume successfully.
Sep 22 23:36:05 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c874a4ef-dc0b-4bf7-814f-c21eaf127e41 tempest-VolumesListTestJSON-968897867 None] Lock "cinder-9c1e08f4-17bb-4478-b002-438a01180e53-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:36:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8d6a74a6-3fe0-4c84-b2fd-2912c0fe4e97 tempest-VolumesListTestJSON-968897867 None] Acquiring lock "cinder-319c0216-e272-480a-bc7e-3fd07c34b975-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:36:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8d6a74a6-3fe0-4c84-b2fd-2912c0fe4e97 tempest-VolumesListTestJSON-968897867 None] Lock "cinder-319c0216-e272-480a-bc7e-3fd07c34b975-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:36:06 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-8d6a74a6-3fe0-4c84-b2fd-2912c0fe4e97 tempest-VolumesListTestJSON-968897867 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:36:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8d6a74a6-3fe0-4c84-b2fd-2912c0fe4e97 tempest-VolumesListTestJSON-968897867 None] Acquiring lock "cinder-quobyte-319c0216-e272-480a-bc7e-3fd07c34b975" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:36:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8d6a74a6-3fe0-4c84-b2fd-2912c0fe4e97 tempest-VolumesListTestJSON-968897867 None] Lock "cinder-quobyte-319c0216-e272-480a-bc7e-3fd07c34b975" acquired by "delete_volume" :: waited 0.017s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:36:06 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[06860bf0-ed09-4963-aba3-97dc25fb3d33]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:36:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8d6a74a6-3fe0-4c84-b2fd-2912c0fe4e97 tempest-VolumesListTestJSON-968897867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-319c0216-e272-480a-bc7e-3fd07c34b975 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:36:06 devstack quobyte-client[84065]: System call of process 97851 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:36:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8d6a74a6-3fe0-4c84-b2fd-2912c0fe4e97 tempest-VolumesListTestJSON-968897867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-319c0216-e272-480a-bc7e-3fd07c34b975" returned: 0 in 0.494s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:36:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8d6a74a6-3fe0-4c84-b2fd-2912c0fe4e97 tempest-VolumesListTestJSON-968897867 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-319c0216-e272-480a-bc7e-3fd07c34b975 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:36:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8d6a74a6-3fe0-4c84-b2fd-2912c0fe4e97 tempest-VolumesListTestJSON-968897867 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-319c0216-e272-480a-bc7e-3fd07c34b975" returned: 0 in 0.163s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:36:07 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8d6a74a6-3fe0-4c84-b2fd-2912c0fe4e97 tempest-VolumesListTestJSON-968897867 None] Lock "cinder-quobyte-319c0216-e272-480a-bc7e-3fd07c34b975" released by "delete_volume" :: held 0.889s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:36:07 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-8d6a74a6-3fe0-4c84-b2fd-2912c0fe4e97 tempest-VolumesListTestJSON-968897867 None] Created reservations ['98b01f8a-d0a9-462f-8b63-b3564fa09b80', '42d10511-f75b-4763-bf61-393dc87e860b', 'ab56d013-7bfe-43d0-ac75-087e22a6c73b', '8f45ef0c-0932-49e8-94de-d03a8f241e11'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:36:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8d6a74a6-3fe0-4c84-b2fd-2912c0fe4e97 tempest-VolumesListTestJSON-968897867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:36:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8d6a74a6-3fe0-4c84-b2fd-2912c0fe4e97 tempest-VolumesListTestJSON-968897867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:36:07 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-8d6a74a6-3fe0-4c84-b2fd-2912c0fe4e97 tempest-VolumesListTestJSON-968897867 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:36:07 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-8d6a74a6-3fe0-4c84-b2fd-2912c0fe4e97 tempest-VolumesListTestJSON-968897867 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:36:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8d6a74a6-3fe0-4c84-b2fd-2912c0fe4e97 tempest-VolumesListTestJSON-968897867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:36:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8d6a74a6-3fe0-4c84-b2fd-2912c0fe4e97 tempest-VolumesListTestJSON-968897867 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:36:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8d6a74a6-3fe0-4c84-b2fd-2912c0fe4e97 tempest-VolumesListTestJSON-968897867 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.108s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:36:08 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-8d6a74a6-3fe0-4c84-b2fd-2912c0fe4e97 tempest-VolumesListTestJSON-968897867 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:36:08 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-8d6a74a6-3fe0-4c84-b2fd-2912c0fe4e97 tempest-VolumesListTestJSON-968897867 None] Deleted volume successfully.
Sep 22 23:36:09 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8d6a74a6-3fe0-4c84-b2fd-2912c0fe4e97 tempest-VolumesListTestJSON-968897867 None] Lock "cinder-319c0216-e272-480a-bc7e-3fd07c34b975-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:36:09 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4527cf01-11f9-457f-845f-3b0236a032ec tempest-VolumesListTestJSON-968897867 None] Acquiring lock "cinder-5c171fd9-6324-4e20-9c21-d9c3c46267d9-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:36:09 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4527cf01-11f9-457f-845f-3b0236a032ec tempest-VolumesListTestJSON-968897867 None] Lock "cinder-5c171fd9-6324-4e20-9c21-d9c3c46267d9-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:36:10 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-4527cf01-11f9-457f-845f-3b0236a032ec tempest-VolumesListTestJSON-968897867 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:36:10 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4527cf01-11f9-457f-845f-3b0236a032ec tempest-VolumesListTestJSON-968897867 None] Acquiring lock "cinder-quobyte-5c171fd9-6324-4e20-9c21-d9c3c46267d9" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:36:10 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4527cf01-11f9-457f-845f-3b0236a032ec tempest-VolumesListTestJSON-968897867 None] Lock "cinder-quobyte-5c171fd9-6324-4e20-9c21-d9c3c46267d9" acquired by "delete_volume" :: waited 0.022s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:36:10 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c775587-f8c8-496e-9435-27d438be4711]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:36:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4527cf01-11f9-457f-845f-3b0236a032ec tempest-VolumesListTestJSON-968897867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5c171fd9-6324-4e20-9c21-d9c3c46267d9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:36:10 devstack quobyte-client[84065]: System call of process 97909 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:36:10 devstack quobyte-client[84065]: System call of process 97909 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:36:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4527cf01-11f9-457f-845f-3b0236a032ec tempest-VolumesListTestJSON-968897867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5c171fd9-6324-4e20-9c21-d9c3c46267d9" returned: 0 in 0.974s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:36:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4527cf01-11f9-457f-845f-3b0236a032ec tempest-VolumesListTestJSON-968897867 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5c171fd9-6324-4e20-9c21-d9c3c46267d9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:36:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4527cf01-11f9-457f-845f-3b0236a032ec tempest-VolumesListTestJSON-968897867 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5c171fd9-6324-4e20-9c21-d9c3c46267d9" returned: 0 in 0.323s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:36:11 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4527cf01-11f9-457f-845f-3b0236a032ec tempest-VolumesListTestJSON-968897867 None] Lock "cinder-quobyte-5c171fd9-6324-4e20-9c21-d9c3c46267d9" released by "delete_volume" :: held 1.665s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:36:12 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-4527cf01-11f9-457f-845f-3b0236a032ec tempest-VolumesListTestJSON-968897867 None] Created reservations ['f72b4154-6b9f-4c11-8165-85e301191732', '0428b2ab-ca6a-42c3-bc6e-cac44954e1a1', '24407d1a-d907-46d7-a6eb-a59832353718', '0c7c2dfa-63e7-4c59-8690-4b6235596267'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:36:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4527cf01-11f9-457f-845f-3b0236a032ec tempest-VolumesListTestJSON-968897867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:36:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4527cf01-11f9-457f-845f-3b0236a032ec tempest-VolumesListTestJSON-968897867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:36:12 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-4527cf01-11f9-457f-845f-3b0236a032ec tempest-VolumesListTestJSON-968897867 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:36:12 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-4527cf01-11f9-457f-845f-3b0236a032ec tempest-VolumesListTestJSON-968897867 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:36:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4527cf01-11f9-457f-845f-3b0236a032ec tempest-VolumesListTestJSON-968897867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:36:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4527cf01-11f9-457f-845f-3b0236a032ec tempest-VolumesListTestJSON-968897867 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:36:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4527cf01-11f9-457f-845f-3b0236a032ec tempest-VolumesListTestJSON-968897867 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.121s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:36:12 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-4527cf01-11f9-457f-845f-3b0236a032ec tempest-VolumesListTestJSON-968897867 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:36:12 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-4527cf01-11f9-457f-845f-3b0236a032ec tempest-VolumesListTestJSON-968897867 None] Deleted volume successfully.
Sep 22 23:36:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4527cf01-11f9-457f-845f-3b0236a032ec tempest-VolumesListTestJSON-968897867 None] Lock "cinder-5c171fd9-6324-4e20-9c21-d9c3c46267d9-delete_volume" released by "delete_volume" :: held 3.250s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:36:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-35ccc07d-b5d3-4783-9622-eb1e9fa0342d tempest-VolumesActionsTest-425497985 None] Acquiring lock "cinder-aa99777b-e3d3-4d31-9fca-bb1164e39e37" by "attach_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:36:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-35ccc07d-b5d3-4783-9622-eb1e9fa0342d tempest-VolumesActionsTest-425497985 None] Lock "cinder-aa99777b-e3d3-4d31-9fca-bb1164e39e37" acquired by "attach_volume" :: waited 0.033s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:36:17 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-35ccc07d-b5d3-4783-9622-eb1e9fa0342d tempest-VolumesActionsTest-425497985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:36:17 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-35ccc07d-b5d3-4783-9622-eb1e9fa0342d tempest-VolumesActionsTest-425497985 None] Attaching volume aa99777b-e3d3-4d31-9fca-bb1164e39e37 to instance a47ea37f-d1e2-4498-bd89-8cd3a6db3781 at mountpoint /dev/vdb on host None.
Sep 22 23:36:17 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-35ccc07d-b5d3-4783-9622-eb1e9fa0342d tempest-VolumesActionsTest-425497985 None] Attach volume completed successfully.
Sep 22 23:36:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-35ccc07d-b5d3-4783-9622-eb1e9fa0342d tempest-VolumesActionsTest-425497985 None] Lock "cinder-aa99777b-e3d3-4d31-9fca-bb1164e39e37" released by "attach_volume" :: held 0.349s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:36:18 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Flow 'volume_create_manager' (a1946aaa-af7f-44e5-ad1d-0253d2274bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8ee3f6-9a2e-4c27-9c61-060ec4240016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8ee3f6-9a2e-4c27-9c61-060ec4240016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1958201080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fccbf649-715a-48b5-b8d4-846756c95d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bd3578c4704570b679bf6235caf70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:36:18Z,use_quota=True,user_id='d157e61fd5a04d69bfa9a0c890ce5b09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60255a81-3f92-497c-9b02-b95e8f92d2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60255a81-3f92-497c-9b02-b95e8f92d2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7dbda8-8b2d-4f24-872d-4725d94d7239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7dbda8-8b2d-4f24-872d-4725d94d7239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fccbf649-715a-48b5-b8d4-846756c95d1f', 'volume_name': 'volume-fccbf649-715a-48b5-b8d4-846756c95d1f', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fc8cbb-4641-4e0c-8b49-832baa4aef6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fc8cbb-4641-4e0c-8b49-832baa4aef6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518ed850-c940-43c2-9638-96f4ec809385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:36:18 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Volume fccbf649-715a-48b5-b8d4-846756c95d1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fccbf649-715a-48b5-b8d4-846756c95d1f', 'volume_size': 1}
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1958201080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fccbf649-715a-48b5-b8d4-846756c95d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bd3578c4704570b679bf6235caf70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:36:18Z,use_quota=True,user_id='d157e61fd5a04d69bfa9a0c890ce5b09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Creating volume fccbf649-715a-48b5-b8d4-846756c95d1f {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:36:18 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-fccbf649-715a-48b5-b8d4-846756c95d1f 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:36:18 devstack quobyte-client[84065]: System call of process 97932 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:36:18 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=113, name=volume-fccbf649-715a-48b5-b8d4-846756c95d1f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e51079e5-e180-43c6-afc4-d2dc45d9fc1a tempest-VolumesActionsTest-425497985 None] Acquiring lock "cinder-aa99777b-e3d3-4d31-9fca-bb1164e39e37-detach_volume" by "detach_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:36:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e51079e5-e180-43c6-afc4-d2dc45d9fc1a tempest-VolumesActionsTest-425497985 None] Lock "cinder-aa99777b-e3d3-4d31-9fca-bb1164e39e37-detach_volume" acquired by "detach_volume" :: waited 0.140s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:36:18 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-e51079e5-e180-43c6-afc4-d2dc45d9fc1a tempest-VolumesActionsTest-425497985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:36:18 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-e51079e5-e180-43c6-afc4-d2dc45d9fc1a tempest-VolumesActionsTest-425497985 None] Detaching volume aa99777b-e3d3-4d31-9fca-bb1164e39e37 from instance a47ea37f-d1e2-4498-bd89-8cd3a6db3781.
Sep 22 23:36:18 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-e51079e5-e180-43c6-afc4-d2dc45d9fc1a tempest-VolumesActionsTest-425497985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:36:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-fccbf649-715a-48b5-b8d4-846756c95d1f 1073741824" returned: 0 in 0.755s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:36:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-fccbf649-715a-48b5-b8d4-846756c95d1f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:36:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-fccbf649-715a-48b5-b8d4-846756c95d1f" returned: 0 in 0.384s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:36:19 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] <== create_volume: return (1206ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:36:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:36:19 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-e51079e5-e180-43c6-afc4-d2dc45d9fc1a tempest-VolumesActionsTest-425497985 None] Detach volume completed successfully.
Sep 22 23:36:19 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518ed850-c940-43c2-9638-96f4ec809385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fccbf649-715a-48b5-b8d4-846756c95d1f', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:36:19 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea01f8c-fe36-4ac5-a8ef-c865d105e3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:36:19 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e51079e5-e180-43c6-afc4-d2dc45d9fc1a tempest-VolumesActionsTest-425497985 None] Lock "cinder-aa99777b-e3d3-4d31-9fca-bb1164e39e37-detach_volume" released by "detach_volume" :: held 0.999s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:36:19 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Volume volume-fccbf649-715a-48b5-b8d4-846756c95d1f (fccbf649-715a-48b5-b8d4-846756c95d1f): created successfully
Sep 22 23:36:19 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea01f8c-fe36-4ac5-a8ef-c865d105e3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:36:19 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Flow 'volume_create_manager' (a1946aaa-af7f-44e5-ad1d-0253d2274bcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:36:19 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-adbfa940-906d-46f4-bb16-e42a76df5bf5 tempest-VolumesNegativeTest-539289364 None] Created volume successfully.
Sep 22 23:36:29 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=25,cinder:SELECT=21,cinder:INSERT=6,cinder:DELETE=2 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:36:29 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:DELETE=3,cinder:SELECT=25,cinder:INSERT=8,cinder:UPDATE=34 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:36:33 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-ae5fdc7c-4dcc-4061-a170-e6c00637fdde tempest-VolumesActionsTest-425497985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:36:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ae5fdc7c-4dcc-4061-a170-e6c00637fdde tempest-VolumesActionsTest-425497985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:36:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ae5fdc7c-4dcc-4061-a170-e6c00637fdde tempest-VolumesActionsTest-425497985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:36:33 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ec4dd9-4dcb-4e34-8be5-dfbf54e99f68]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:36:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ae5fdc7c-4dcc-4061-a170-e6c00637fdde tempest-VolumesActionsTest-425497985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:36:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ae5fdc7c-4dcc-4061-a170-e6c00637fdde tempest-VolumesActionsTest-425497985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37" returned: 0 in 0.495s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:36:33 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4159a7e-22d7-412c-b5e1-4c78be3dafa7]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:36:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ae5fdc7c-4dcc-4061-a170-e6c00637fdde tempest-VolumesActionsTest-425497985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:36:34 devstack quobyte-client[84065]: System call of process 98040 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:36:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ae5fdc7c-4dcc-4061-a170-e6c00637fdde tempest-VolumesActionsTest-425497985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37" returned: 0 in 0.459s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:36:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ae5fdc7c-4dcc-4061-a170-e6c00637fdde tempest-VolumesActionsTest-425497985 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37 /opt/stack/data/cinder/conversion/aa99777b-e3d3-4d31-9fca-bb1164e39e37.temp_image.c45dfc01-b24f-4f3f-b549-05c99743ef52zhabwbne.img {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:36:34 devstack quobyte-client[84065]: System call of process 98043 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:36:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ae5fdc7c-4dcc-4061-a170-e6c00637fdde tempest-VolumesActionsTest-425497985 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37 /opt/stack/data/cinder/conversion/aa99777b-e3d3-4d31-9fca-bb1164e39e37.temp_image.c45dfc01-b24f-4f3f-b549-05c99743ef52zhabwbne.img" returned: 0 in 7.104s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:36:41 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb4172a-1115-4fa3-afda-c8781559fb94]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:36:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ae5fdc7c-4dcc-4061-a170-e6c00637fdde tempest-VolumesActionsTest-425497985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:36:42 devstack quobyte-client[84065]: System call of process 98080 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:36:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ae5fdc7c-4dcc-4061-a170-e6c00637fdde tempest-VolumesActionsTest-425497985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37" returned: 0 in 1.165s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:36:42 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-ae5fdc7c-4dcc-4061-a170-e6c00637fdde tempest-VolumesActionsTest-425497985 None] Image conversion details: src /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37, size 1024.00 MB, duration 7.14 sec, destination /opt/stack/data/cinder/conversion/aa99777b-e3d3-4d31-9fca-bb1164e39e37.temp_image.c45dfc01-b24f-4f3f-b549-05c99743ef52zhabwbne.img {{(pid=84012) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 22 23:36:42 devstack cinder-volume[84012]: INFO cinder.image.image_utils [None req-ae5fdc7c-4dcc-4061-a170-e6c00637fdde tempest-VolumesActionsTest-425497985 None] Converted 1024.00 MB image at 143.41 MB/s
Sep 22 23:36:43 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:36:44 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-ae5fdc7c-4dcc-4061-a170-e6c00637fdde tempest-VolumesActionsTest-425497985 None] c45dfc01-b24f-4f3f-b549-05c99743ef52 was raw, no need to convert to raw {{(pid=84012) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 22 23:36:48 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:36:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:36:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:36:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:36:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:36:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:36:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:36:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.290s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:36:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:36:54 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=2 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:37:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-7728a2b8-bbe9-45df-a866-ed8580c8136a tempest-VolumesNegativeTest-539289364 None] Acquiring lock "cinder-fccbf649-715a-48b5-b8d4-846756c95d1f-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:37:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-7728a2b8-bbe9-45df-a866-ed8580c8136a tempest-VolumesNegativeTest-539289364 None] Lock "cinder-fccbf649-715a-48b5-b8d4-846756c95d1f-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:37:12 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-7728a2b8-bbe9-45df-a866-ed8580c8136a tempest-VolumesNegativeTest-539289364 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:37:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-7728a2b8-bbe9-45df-a866-ed8580c8136a tempest-VolumesNegativeTest-539289364 None] Acquiring lock "cinder-quobyte-fccbf649-715a-48b5-b8d4-846756c95d1f" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:37:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-7728a2b8-bbe9-45df-a866-ed8580c8136a tempest-VolumesNegativeTest-539289364 None] Lock "cinder-quobyte-fccbf649-715a-48b5-b8d4-846756c95d1f" acquired by "delete_volume" :: waited 0.072s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:37:12 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f084ef8f-12a4-49ea-85cb-b06988490e94]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:37:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7728a2b8-bbe9-45df-a866-ed8580c8136a tempest-VolumesNegativeTest-539289364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-fccbf649-715a-48b5-b8d4-846756c95d1f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:13 devstack quobyte-client[84065]: System call of process 98231 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:37:13 devstack quobyte-client[84065]: System call of process 98231 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:37:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7728a2b8-bbe9-45df-a866-ed8580c8136a tempest-VolumesNegativeTest-539289364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-fccbf649-715a-48b5-b8d4-846756c95d1f" returned: 0 in 0.706s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7728a2b8-bbe9-45df-a866-ed8580c8136a tempest-VolumesNegativeTest-539289364 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-fccbf649-715a-48b5-b8d4-846756c95d1f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7728a2b8-bbe9-45df-a866-ed8580c8136a tempest-VolumesNegativeTest-539289364 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-fccbf649-715a-48b5-b8d4-846756c95d1f" returned: 0 in 0.169s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:13 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-7728a2b8-bbe9-45df-a866-ed8580c8136a tempest-VolumesNegativeTest-539289364 None] Lock "cinder-quobyte-fccbf649-715a-48b5-b8d4-846756c95d1f" released by "delete_volume" :: held 1.146s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:37:14 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-7728a2b8-bbe9-45df-a866-ed8580c8136a tempest-VolumesNegativeTest-539289364 None] Created reservations ['cb4a32be-aab2-43d8-b4fd-8541ad1997c7', '00cd26f5-28ab-49fa-a102-b1656e8baf10', '0393e1eb-d761-4762-915c-00b70d3550ba', '3ff60c38-18e0-4e72-8860-a8f839d72143'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:37:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-7728a2b8-bbe9-45df-a866-ed8580c8136a tempest-VolumesNegativeTest-539289364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:37:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-7728a2b8-bbe9-45df-a866-ed8580c8136a tempest-VolumesNegativeTest-539289364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:37:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-7728a2b8-bbe9-45df-a866-ed8580c8136a tempest-VolumesNegativeTest-539289364 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:37:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-7728a2b8-bbe9-45df-a866-ed8580c8136a tempest-VolumesNegativeTest-539289364 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:37:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-7728a2b8-bbe9-45df-a866-ed8580c8136a tempest-VolumesNegativeTest-539289364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:37:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7728a2b8-bbe9-45df-a866-ed8580c8136a tempest-VolumesNegativeTest-539289364 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-7728a2b8-bbe9-45df-a866-ed8580c8136a tempest-VolumesNegativeTest-539289364 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.158s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:14 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-7728a2b8-bbe9-45df-a866-ed8580c8136a tempest-VolumesNegativeTest-539289364 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:37:14 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-7728a2b8-bbe9-45df-a866-ed8580c8136a tempest-VolumesNegativeTest-539289364 None] Deleted volume successfully.
Sep 22 23:37:15 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-7728a2b8-bbe9-45df-a866-ed8580c8136a tempest-VolumesNegativeTest-539289364 None] Lock "cinder-fccbf649-715a-48b5-b8d4-846756c95d1f-delete_volume" released by "delete_volume" :: held 2.853s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:37:19 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:37:19 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:37:19 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Flow 'volume_create_manager' (aba875cb-3891-4597-9c9d-ec7a084803b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:37:19 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd0debf-f914-4701-9fb0-ecc93846316c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:37:19 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd0debf-f914-4701-9fb0-ecc93846316c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2117411986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1375eeeb-7136-4d2b-96a9-b59e683077ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24ea6b77fe74490a528351b73b33969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:37:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:37:19Z,use_quota=True,user_id='85c267edf0324e0388e01a4dfe698e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:37:19 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d588296-5a1e-44c7-b82e-95406ec0731b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:37:19 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d588296-5a1e-44c7-b82e-95406ec0731b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:37:19 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee877586-7353-4a9e-bc35-99cf5fe4c26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:37:19 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee877586-7353-4a9e-bc35-99cf5fe4c26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1375eeeb-7136-4d2b-96a9-b59e683077ef', 'volume_name': 'volume-1375eeeb-7136-4d2b-96a9-b59e683077ef', 'volume_size': 2}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:37:19 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e191fb2-5963-42f0-be75-935aa586038f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:37:19 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e191fb2-5963-42f0-be75-935aa586038f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:37:19 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b52193-0804-48e7-a175-a6fd92a163c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:37:19 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Volume 1375eeeb-7136-4d2b-96a9-b59e683077ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1375eeeb-7136-4d2b-96a9-b59e683077ef', 'volume_size': 2}
Sep 22 23:37:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:37:29 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:INSERT=4,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:37:29 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=4,cinder:UPDATE=8 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:37:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ae5fdc7c-4dcc-4061-a170-e6c00637fdde tempest-VolumesActionsTest-425497985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 60.574s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:37:33 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ae5fdc7c-4dcc-4061-a170-e6c00637fdde tempest-VolumesActionsTest-425497985 None] Uploaded volume to glance image-id: c45dfc01-b24f-4f3f-b549-05c99743ef52. {{(pid=84012) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 22 23:37:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.196s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:37:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2117411986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1375eeeb-7136-4d2b-96a9-b59e683077ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24ea6b77fe74490a528351b73b33969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:37:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:37:19Z,use_quota=True,user_id='85c267edf0324e0388e01a4dfe698e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:37:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Creating volume 1375eeeb-7136-4d2b-96a9-b59e683077ef {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:37:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:37:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:37:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:37:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:37:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:37:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:37:33 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:37:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef 2147483648 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:33 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=114, name=volume-1375eeeb-7136-4d2b-96a9-b59e683077ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:37:34 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-ae5fdc7c-4dcc-4061-a170-e6c00637fdde tempest-VolumesActionsTest-425497985 None] Copy volume to image completed successfully.
Sep 22 23:37:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef 2147483648" returned: 0 in 0.590s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef" returned: 0 in 0.089s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:34 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] <== create_volume: return (738ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:37:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:37:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b52193-0804-48e7-a175-a6fd92a163c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1375eeeb-7136-4d2b-96a9-b59e683077ef', 'volume_size': 2}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:37:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (840ff419-4cc8-44ce-9ec8-dce7fe6e732b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:37:34 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Volume volume-1375eeeb-7136-4d2b-96a9-b59e683077ef (1375eeeb-7136-4d2b-96a9-b59e683077ef): created successfully
Sep 22 23:37:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (840ff419-4cc8-44ce-9ec8-dce7fe6e732b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:37:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Flow 'volume_create_manager' (aba875cb-3891-4597-9c9d-ec7a084803b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:37:34 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-29035a36-bbad-4ed5-a22c-f88eb87cc9ef tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Created volume successfully.
Sep 22 23:37:35 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:37:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:37:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:37:35 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28da2c9-4a16-4b67-9ec1-fc5df971b9d1]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:37:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37" returned: 0 in 0.433s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:35 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc0e68f-a787-4a69-b243-f306adbc739e]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:37:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:36 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:37:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:37:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37" returned: 0 in 0.499s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37 /opt/stack/data/cinder/conversion/aa99777b-e3d3-4d31-9fca-bb1164e39e37.temp_image.dd4b0790-3231-4129-8670-315ebd24c4b3y7fuxop6.img {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:36 devstack quobyte-client[84065]: System call of process 98252 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:37:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37 /opt/stack/data/cinder/conversion/aa99777b-e3d3-4d31-9fca-bb1164e39e37.temp_image.dd4b0790-3231-4129-8670-315ebd24c4b3y7fuxop6.img" returned: 0 in 5.472s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:41 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b19fc3b-6fd9-4688-8020-f0d1414879d3]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:37:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37" returned: 0 in 0.609s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:42 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] Image conversion details: src /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37, size 1024.00 MB, duration 5.50 sec, destination /opt/stack/data/cinder/conversion/aa99777b-e3d3-4d31-9fca-bb1164e39e37.temp_image.dd4b0790-3231-4129-8670-315ebd24c4b3y7fuxop6.img {{(pid=84012) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 22 23:37:42 devstack cinder-volume[84012]: INFO cinder.image.image_utils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] Converted 1024.00 MB image at 186.11 MB/s
Sep 22 23:37:42 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] dd4b0790-3231-4129-8670-315ebd24c4b3 was raw, converting to qcow2 {{(pid=84012) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 22 23:37:42 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[33334928-574b-4cb5-8f84-65a803943c84]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:37:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/aa99777b-e3d3-4d31-9fca-bb1164e39e37.temp_image.dd4b0790-3231-4129-8670-315ebd24c4b3y7fuxop6.img {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/aa99777b-e3d3-4d31-9fca-bb1164e39e37.temp_image.dd4b0790-3231-4129-8670-315ebd24c4b3y7fuxop6.img" returned: 0 in 0.348s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/aa99777b-e3d3-4d31-9fca-bb1164e39e37.temp_image.dd4b0790-3231-4129-8670-315ebd24c4b3y7fuxop6.img {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/aa99777b-e3d3-4d31-9fca-bb1164e39e37.temp_image.dd4b0790-3231-4129-8670-315ebd24c4b3y7fuxop6.img" returned: 1 in 0.340s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/aa99777b-e3d3-4d31-9fca-bb1164e39e37.temp_image.dd4b0790-3231-4129-8670-315ebd24c4b3y7fuxop6.img' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:37:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/aa99777b-e3d3-4d31-9fca-bb1164e39e37.temp_image.dd4b0790-3231-4129-8670-315ebd24c4b3y7fuxop6.img /opt/stack/data/cinder/conversion/vol_upload_so5nh0xg {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/aa99777b-e3d3-4d31-9fca-bb1164e39e37.temp_image.dd4b0790-3231-4129-8670-315ebd24c4b3y7fuxop6.img /opt/stack/data/cinder/conversion/vol_upload_so5nh0xg" returned: 0 in 0.124s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:43 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] Image conversion details: src /opt/stack/data/cinder/conversion/aa99777b-e3d3-4d31-9fca-bb1164e39e37.temp_image.dd4b0790-3231-4129-8670-315ebd24c4b3y7fuxop6.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_so5nh0xg {{(pid=84012) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 22 23:37:43 devstack cinder-volume[84012]: INFO cinder.image.image_utils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 22 23:37:43 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d832817f-9e3a-41cb-9c5f-80d05663596e]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:37:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_so5nh0xg {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:44 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_so5nh0xg" returned: 0 in 0.344s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.049s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:37:45 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] Uploaded volume to glance image-id: dd4b0790-3231-4129-8670-315ebd24c4b3. {{(pid=84012) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 22 23:37:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.234s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:37:45 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Creating offline snapshot 42d0e34a-088f-46e3-bd19-eae94d07aa22 of volume 1375eeeb-7136-4d2b-96a9-b59e683077ef {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:37:45 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-fe7c8000-bf0f-43be-a4c8-25567f42d2cb tempest-VolumesActionsTest-425497985 None] Copy volume to image completed successfully.
Sep 22 23:37:45 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60d38cf-07dd-482d-a6e0-936727c682a9]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:37:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:46 devstack quobyte-client[84065]: System call of process 98309 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:37:46 devstack quobyte-client[84065]: System call of process 98309 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:37:46 devstack quobyte-client[84065]: System call of process 98309 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:37:46 devstack quobyte-client[84065]: System call of process 98309 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:37:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef" returned: 0 in 0.637s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.42d0e34a-088f-46e3-bd19-eae94d07aa22 2G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:46 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=115, name=volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.42d0e34a-088f-46e3-bd19-eae94d07aa22, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:37:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.42d0e34a-088f-46e3-bd19-eae94d07aa22 2G" returned: 0 in 0.277s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1375eeeb-7136-4d2b-96a9-b59e683077ef -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.42d0e34a-088f-46e3-bd19-eae94d07aa22 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:46 devstack quobyte-client[84065]: System call of process 98318 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:37:46 devstack quobyte-client[84065]: System call of process 98318 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:37:46 devstack quobyte-client[84065]: System call of process 98318 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:37:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] CMD "qemu-img rebase -u -b volume-1375eeeb-7136-4d2b-96a9-b59e683077ef -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.42d0e34a-088f-46e3-bd19-eae94d07aa22" returned: 0 in 0.326s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.42d0e34a-088f-46e3-bd19-eae94d07aa22 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:37:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.42d0e34a-088f-46e3-bd19-eae94d07aa22 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:47 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-bcb02bd2-c73f-4c4d-bd48-3ef8a11a81a8 tempest-VolumesActionsTest-425497985 None] Acquiring lock "cinder-aa99777b-e3d3-4d31-9fca-bb1164e39e37-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:37:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.42d0e34a-088f-46e3-bd19-eae94d07aa22" returned: 0 in 0.400s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:37:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.42d0e34a-088f-46e3-bd19-eae94d07aa22 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:47 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-bcb02bd2-c73f-4c4d-bd48-3ef8a11a81a8 tempest-VolumesActionsTest-425497985 None] Lock "cinder-aa99777b-e3d3-4d31-9fca-bb1164e39e37-delete_volume" acquired by "delete_volume" :: waited 0.274s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:37:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.42d0e34a-088f-46e3-bd19-eae94d07aa22" returned: 0 in 0.372s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:48 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:37:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:37:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:37:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:37:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:37:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:37:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.info" returned: 0 in 0.597s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:48 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-bcb02bd2-c73f-4c4d-bd48-3ef8a11a81a8 tempest-VolumesActionsTest-425497985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:37:48 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-bcb02bd2-c73f-4c4d-bd48-3ef8a11a81a8 tempest-VolumesActionsTest-425497985 None] Acquiring lock "cinder-quobyte-aa99777b-e3d3-4d31-9fca-bb1164e39e37" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:37:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.info is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:37:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.490s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:37:48 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-bcb02bd2-c73f-4c4d-bd48-3ef8a11a81a8 tempest-VolumesActionsTest-425497985 None] Lock "cinder-quobyte-aa99777b-e3d3-4d31-9fca-bb1164e39e37" acquired by "delete_volume" :: waited 0.249s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:37:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.info" returned: 0 in 0.249s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.344s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:37:48 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d63469-847f-4e5b-bbc6-1175a3b8eef6]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:37:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bcb02bd2-c73f-4c4d-bd48-3ef8a11a81a8 tempest-VolumesActionsTest-425497985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:49 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-e4afbf8f-703d-492d-ac47-1d9d902c7761 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Create snapshot completed successfully
Sep 22 23:37:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bcb02bd2-c73f-4c4d-bd48-3ef8a11a81a8 tempest-VolumesActionsTest-425497985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37" returned: 0 in 0.503s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bcb02bd2-c73f-4c4d-bd48-3ef8a11a81a8 tempest-VolumesActionsTest-425497985 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bcb02bd2-c73f-4c4d-bd48-3ef8a11a81a8 tempest-VolumesActionsTest-425497985 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa99777b-e3d3-4d31-9fca-bb1164e39e37" returned: 0 in 0.099s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:49 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-bcb02bd2-c73f-4c4d-bd48-3ef8a11a81a8 tempest-VolumesActionsTest-425497985 None] Lock "cinder-quobyte-aa99777b-e3d3-4d31-9fca-bb1164e39e37" released by "delete_volume" :: held 0.910s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:37:49 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-bcb02bd2-c73f-4c4d-bd48-3ef8a11a81a8 tempest-VolumesActionsTest-425497985 None] Created reservations ['3b8f5587-661c-471b-a572-62a6073c386d', 'd3dcd9fb-0695-44c5-9e92-da385f91b5ea', '60f95079-ed58-4f50-86a9-1468aba5612c', '3ea2e29f-d1b1-4766-a228-6f83c8d5b102'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:37:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-bcb02bd2-c73f-4c4d-bd48-3ef8a11a81a8 tempest-VolumesActionsTest-425497985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:37:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-bcb02bd2-c73f-4c4d-bd48-3ef8a11a81a8 tempest-VolumesActionsTest-425497985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:37:50 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-bcb02bd2-c73f-4c4d-bd48-3ef8a11a81a8 tempest-VolumesActionsTest-425497985 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:37:50 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-bcb02bd2-c73f-4c4d-bd48-3ef8a11a81a8 tempest-VolumesActionsTest-425497985 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:37:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-bcb02bd2-c73f-4c4d-bd48-3ef8a11a81a8 tempest-VolumesActionsTest-425497985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:37:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bcb02bd2-c73f-4c4d-bd48-3ef8a11a81a8 tempest-VolumesActionsTest-425497985 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bcb02bd2-c73f-4c4d-bd48-3ef8a11a81a8 tempest-VolumesActionsTest-425497985 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.081s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:50 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-bcb02bd2-c73f-4c4d-bd48-3ef8a11a81a8 tempest-VolumesActionsTest-425497985 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:37:50 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-bcb02bd2-c73f-4c4d-bd48-3ef8a11a81a8 tempest-VolumesActionsTest-425497985 None] Deleted volume successfully.
Sep 22 23:37:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-bcb02bd2-c73f-4c4d-bd48-3ef8a11a81a8 tempest-VolumesActionsTest-425497985 None] Lock "cinder-aa99777b-e3d3-4d31-9fca-bb1164e39e37-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:37:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Acquiring lock "cinder-42d0e34a-088f-46e3-bd19-eae94d07aa22-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:37:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Lock "cinder-42d0e34a-088f-46e3-bd19-eae94d07aa22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:37:50 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:37:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Acquiring lock "cinder-quobyte-1375eeeb-7136-4d2b-96a9-b59e683077ef" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:37:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Lock "cinder-quobyte-1375eeeb-7136-4d2b-96a9-b59e683077ef" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:37:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Acquiring lock "cinder-quobyte-42d0e34a-088f-46e3-bd19-eae94d07aa22" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:37:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Lock "cinder-quobyte-42d0e34a-088f-46e3-bd19-eae94d07aa22" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:37:50 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Deleting offline snapshot 42d0e34a-088f-46e3-bd19-eae94d07aa22 of volume 1375eeeb-7136-4d2b-96a9-b59e683077ef {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:37:50 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] snapshot_file for this snap is: volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.42d0e34a-088f-46e3-bd19-eae94d07aa22 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:37:50 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa52428-f5bb-4a81-90ca-7846a17e9474]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:37:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.42d0e34a-088f-46e3-bd19-eae94d07aa22 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:51 devstack quobyte-client[84065]: System call of process 98331 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:37:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.42d0e34a-088f-46e3-bd19-eae94d07aa22" returned: 0 in 0.508s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1375eeeb-7136-4d2b-96a9-b59e683077ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:37:51 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd71a92-cd14-427b-ac10-47c8a9462bea]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:37:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:51 devstack quobyte-client[84065]: System call of process 98334 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:37:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef" returned: 0 in 0.461s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.42d0e34a-088f-46e3-bd19-eae94d07aa22 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:51 devstack quobyte-client[84065]: System call of process 98337 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:37:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.42d0e34a-088f-46e3-bd19-eae94d07aa22" returned: 0 in 0.278s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.42d0e34a-088f-46e3-bd19-eae94d07aa22 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef.42d0e34a-088f-46e3-bd19-eae94d07aa22" returned: 0 in 0.109s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Lock "cinder-quobyte-42d0e34a-088f-46e3-bd19-eae94d07aa22" released by "_delete_snapshot" :: held 1.720s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:37:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Lock "cinder-quobyte-1375eeeb-7136-4d2b-96a9-b59e683077ef" released by "delete_snapshot" :: held 1.745s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:37:52 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Created reservations ['24e08497-01db-404e-8605-b031d194cd4c', 'a780d97e-9e86-4c03-89ef-32a0fca166eb', '1fae0bfc-cb74-4fa3-8379-7018235e61e6', 'f0b9b45e-b3a9-49ad-8b31-b359424dfe37'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:37:52 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Delete snapshot completed successfully.
Sep 22 23:37:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-e5930e13-ff6a-47af-b8f2-bd47b552ffdc tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Lock "cinder-42d0e34a-088f-46e3-bd19-eae94d07aa22-delete_snapshot" released by "delete_snapshot" :: held 2.304s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:37:53 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-de9be770-c618-4490-8f72-4a5f6e6f47e6 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Acquiring lock "cinder-1375eeeb-7136-4d2b-96a9-b59e683077ef-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:37:53 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-de9be770-c618-4490-8f72-4a5f6e6f47e6 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Lock "cinder-1375eeeb-7136-4d2b-96a9-b59e683077ef-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:37:54 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-de9be770-c618-4490-8f72-4a5f6e6f47e6 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:37:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-de9be770-c618-4490-8f72-4a5f6e6f47e6 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Acquiring lock "cinder-quobyte-1375eeeb-7136-4d2b-96a9-b59e683077ef" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:37:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-de9be770-c618-4490-8f72-4a5f6e6f47e6 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Lock "cinder-quobyte-1375eeeb-7136-4d2b-96a9-b59e683077ef" acquired by "delete_volume" :: waited 0.025s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:37:54 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77a622a-10c9-452e-80a3-5f9e5013b186]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:37:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-de9be770-c618-4490-8f72-4a5f6e6f47e6 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:54 devstack quobyte-client[84065]: System call of process 98342 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:37:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-de9be770-c618-4490-8f72-4a5f6e6f47e6 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef" returned: 0 in 0.512s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-de9be770-c618-4490-8f72-4a5f6e6f47e6 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-de9be770-c618-4490-8f72-4a5f6e6f47e6 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-1375eeeb-7136-4d2b-96a9-b59e683077ef" returned: 0 in 0.130s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-de9be770-c618-4490-8f72-4a5f6e6f47e6 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Lock "cinder-quobyte-1375eeeb-7136-4d2b-96a9-b59e683077ef" released by "delete_volume" :: held 0.836s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:37:55 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-de9be770-c618-4490-8f72-4a5f6e6f47e6 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Created reservations ['77ce0e8b-9c6f-4764-b524-eaedbabb2404', '5a849c85-3e64-49c6-a927-099a5f50e61d', 'f741eef3-446b-4c74-b663-692d9bc6d632', 'e125a6e2-ca03-4092-baba-14be07d38cda'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:37:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-de9be770-c618-4490-8f72-4a5f6e6f47e6 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:37:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-de9be770-c618-4490-8f72-4a5f6e6f47e6 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:37:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-de9be770-c618-4490-8f72-4a5f6e6f47e6 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:37:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-de9be770-c618-4490-8f72-4a5f6e6f47e6 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:37:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-de9be770-c618-4490-8f72-4a5f6e6f47e6 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:37:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-de9be770-c618-4490-8f72-4a5f6e6f47e6 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:37:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-de9be770-c618-4490-8f72-4a5f6e6f47e6 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.123s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:37:55 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-de9be770-c618-4490-8f72-4a5f6e6f47e6 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:37:55 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-de9be770-c618-4490-8f72-4a5f6e6f47e6 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Deleted volume successfully.
Sep 22 23:37:56 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-de9be770-c618-4490-8f72-4a5f6e6f47e6 tempest-VolumesSnapshotNegativeTestJSON-1439814332 None] Lock "cinder-1375eeeb-7136-4d2b-96a9-b59e683077ef-delete_volume" released by "delete_volume" :: held 2.113s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:38:00 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Flow 'volume_create_manager' (99becb98-565e-400d-83ef-42a197be1b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abfd17c-6ce2-4b6a-a712-f9d0fcd6382e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abfd17c-6ce2-4b6a-a712-f9d0fcd6382e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-794503508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39dab7ce-12dd-4a50-927e-217b0e79768a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3040161b4b4c49e28c1d6864a4c3a0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:38:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:38:00Z,use_quota=True,user_id='6cf22518a2954b65b86562bd74646131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c96225fc-be04-4532-bde9-a36224d9df91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c96225fc-be04-4532-bde9-a36224d9df91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee61344-4689-4645-ab6a-fa0f98cda64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee61344-4689-4645-ab6a-fa0f98cda64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39dab7ce-12dd-4a50-927e-217b0e79768a', 'volume_name': 'volume-39dab7ce-12dd-4a50-927e-217b0e79768a', 'volume_size': 2}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48852468-00bb-492d-8a8e-ccad432729ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48852468-00bb-492d-8a8e-ccad432729ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12297512-c5f8-4637-b744-a42c674bbc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:00 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Volume 39dab7ce-12dd-4a50-927e-217b0e79768a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39dab7ce-12dd-4a50-927e-217b0e79768a', 'volume_size': 2}
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-794503508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39dab7ce-12dd-4a50-927e-217b0e79768a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3040161b4b4c49e28c1d6864a4c3a0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:38:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:38:00Z,use_quota=True,user_id='6cf22518a2954b65b86562bd74646131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Creating volume 39dab7ce-12dd-4a50-927e-217b0e79768a {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:38:00 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:38:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39dab7ce-12dd-4a50-927e-217b0e79768a 2147483648 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:00 devstack quobyte-client[84065]: System call of process 98355 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:38:00 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=117, name=volume-39dab7ce-12dd-4a50-927e-217b0e79768a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:38:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39dab7ce-12dd-4a50-927e-217b0e79768a 2147483648" returned: 0 in 0.613s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39dab7ce-12dd-4a50-927e-217b0e79768a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39dab7ce-12dd-4a50-927e-217b0e79768a" returned: 0 in 0.108s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] <== create_volume: return (816ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:38:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:38:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12297512-c5f8-4637-b744-a42c674bbc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39dab7ce-12dd-4a50-927e-217b0e79768a', 'volume_size': 2}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2fd24d-625b-4dcd-a2ea-aabb4478e889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:01 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Volume volume-39dab7ce-12dd-4a50-927e-217b0e79768a (39dab7ce-12dd-4a50-927e-217b0e79768a): created successfully
Sep 22 23:38:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2fd24d-625b-4dcd-a2ea-aabb4478e889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Flow 'volume_create_manager' (99becb98-565e-400d-83ef-42a197be1b82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:38:01 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-082f7944-77ed-49ee-a371-e4a6bd4bea17 tempest-VolumesCloneNegativeTest-71529655 None] Created volume successfully.
Sep 22 23:38:02 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-73d0b9d3-b67b-4977-8702-ede659571f95 tempest-VolumesCloneNegativeTest-71529655 None] Acquiring lock "cinder-39dab7ce-12dd-4a50-927e-217b0e79768a-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:38:02 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-73d0b9d3-b67b-4977-8702-ede659571f95 tempest-VolumesCloneNegativeTest-71529655 None] Lock "cinder-39dab7ce-12dd-4a50-927e-217b0e79768a-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:38:02 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-73d0b9d3-b67b-4977-8702-ede659571f95 tempest-VolumesCloneNegativeTest-71529655 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:38:03 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-73d0b9d3-b67b-4977-8702-ede659571f95 tempest-VolumesCloneNegativeTest-71529655 None] Acquiring lock "cinder-quobyte-39dab7ce-12dd-4a50-927e-217b0e79768a" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:38:03 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-73d0b9d3-b67b-4977-8702-ede659571f95 tempest-VolumesCloneNegativeTest-71529655 None] Lock "cinder-quobyte-39dab7ce-12dd-4a50-927e-217b0e79768a" acquired by "delete_volume" :: waited 0.014s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:38:03 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6f0e7c-a2e1-4ae9-95e3-aa35bfab3265]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:38:03 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-73d0b9d3-b67b-4977-8702-ede659571f95 tempest-VolumesCloneNegativeTest-71529655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39dab7ce-12dd-4a50-927e-217b0e79768a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:03 devstack quobyte-client[84065]: System call of process 98359 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:38:03 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-73d0b9d3-b67b-4977-8702-ede659571f95 tempest-VolumesCloneNegativeTest-71529655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39dab7ce-12dd-4a50-927e-217b0e79768a" returned: 0 in 0.537s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:03 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-73d0b9d3-b67b-4977-8702-ede659571f95 tempest-VolumesCloneNegativeTest-71529655 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39dab7ce-12dd-4a50-927e-217b0e79768a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:03 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-73d0b9d3-b67b-4977-8702-ede659571f95 tempest-VolumesCloneNegativeTest-71529655 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-39dab7ce-12dd-4a50-927e-217b0e79768a" returned: 0 in 0.102s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:03 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-73d0b9d3-b67b-4977-8702-ede659571f95 tempest-VolumesCloneNegativeTest-71529655 None] Lock "cinder-quobyte-39dab7ce-12dd-4a50-927e-217b0e79768a" released by "delete_volume" :: held 0.835s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:38:04 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-73d0b9d3-b67b-4977-8702-ede659571f95 tempest-VolumesCloneNegativeTest-71529655 None] Created reservations ['568d1db0-ab2d-4178-a9cf-e33e03119cc6', 'd6fb654f-f424-4242-9968-be6699119ba0', '37792616-b826-4690-8219-3b7c320a41bf', 'faafe148-ac47-4a42-807c-bddeded51da5'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:38:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-73d0b9d3-b67b-4977-8702-ede659571f95 tempest-VolumesCloneNegativeTest-71529655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:38:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-73d0b9d3-b67b-4977-8702-ede659571f95 tempest-VolumesCloneNegativeTest-71529655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:38:04 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-73d0b9d3-b67b-4977-8702-ede659571f95 tempest-VolumesCloneNegativeTest-71529655 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:38:04 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-73d0b9d3-b67b-4977-8702-ede659571f95 tempest-VolumesCloneNegativeTest-71529655 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:38:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-73d0b9d3-b67b-4977-8702-ede659571f95 tempest-VolumesCloneNegativeTest-71529655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:38:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-73d0b9d3-b67b-4977-8702-ede659571f95 tempest-VolumesCloneNegativeTest-71529655 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-73d0b9d3-b67b-4977-8702-ede659571f95 tempest-VolumesCloneNegativeTest-71529655 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.090s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:04 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-73d0b9d3-b67b-4977-8702-ede659571f95 tempest-VolumesCloneNegativeTest-71529655 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:38:04 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-73d0b9d3-b67b-4977-8702-ede659571f95 tempest-VolumesCloneNegativeTest-71529655 None] Deleted volume successfully.
Sep 22 23:38:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-73d0b9d3-b67b-4977-8702-ede659571f95 tempest-VolumesCloneNegativeTest-71529655 None] Lock "cinder-39dab7ce-12dd-4a50-927e-217b0e79768a-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:38:14 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=22,cinder:UPDATE=36,cinder:DELETE=4,cinder:INSERT=10 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:38:14 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=34,cinder:DELETE=2,cinder:SELECT=27,cinder:INSERT=6 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:38:29 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:38:29 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:38:34 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Flow 'volume_create_manager' (4ca706af-beec-4861-b49b-8052b02d8e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e30a297-0b8b-4df4-945d-2999acc20691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e30a297-0b8b-4df4-945d-2999acc20691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1376248333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9b77ca-c119-4554-a18a-d890b0b96e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ec3735ba264bfc9621721989a35926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:38:34Z,use_quota=True,user_id='4548c00a7b0049979af0581e126c26e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fa18afb-1bf9-463a-830a-ebcd2fc22a69),volume_type_id=8fa18afb-1bf9-463a-830a-ebcd2fc22a69)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa23a67-9872-4a7e-ad1d-a558b83c6337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa23a67-9872-4a7e-ad1d-a558b83c6337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d614987b-6cc5-4062-8795-cf41cb77b072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d614987b-6cc5-4062-8795-cf41cb77b072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b9b77ca-c119-4554-a18a-d890b0b96e75', 'volume_name': 'volume-3b9b77ca-c119-4554-a18a-d890b0b96e75', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec211ae-6784-492d-8ae8-ebc4bb70385a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aec211ae-6784-492d-8ae8-ebc4bb70385a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63814ae3-5233-4fd2-a65c-1822b206a947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:34 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume 3b9b77ca-c119-4554-a18a-d890b0b96e75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b9b77ca-c119-4554-a18a-d890b0b96e75', 'volume_size': 1}
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1376248333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9b77ca-c119-4554-a18a-d890b0b96e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ec3735ba264bfc9621721989a35926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:38:34Z,use_quota=True,user_id='4548c00a7b0049979af0581e126c26e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fa18afb-1bf9-463a-830a-ebcd2fc22a69),volume_type_id=8fa18afb-1bf9-463a-830a-ebcd2fc22a69)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Creating volume 3b9b77ca-c119-4554-a18a-d890b0b96e75 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:38:34 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:38:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3b9b77ca-c119-4554-a18a-d890b0b96e75 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:34 devstack quobyte-client[84065]: System call of process 98371 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:38:34 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=118, name=volume-3b9b77ca-c119-4554-a18a-d890b0b96e75, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:38:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3b9b77ca-c119-4554-a18a-d890b0b96e75 1073741824" returned: 0 in 0.910s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3b9b77ca-c119-4554-a18a-d890b0b96e75 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:35 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:38:35 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:38:35 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Flow 'volume_create_manager' (9d032f0d-63ec-438e-9c12-ef4a49a2e83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf7f602-e56e-45d2-a0ad-26d0fe041c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3b9b77ca-c119-4554-a18a-d890b0b96e75" returned: 0 in 0.537s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] <== create_volume: return (1514ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf7f602-e56e-45d2-a0ad-26d0fe041c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-994316096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468b9d13-2efe-4692-b0ac-3925b44513a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ec3735ba264bfc9621721989a35926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:38:35Z,use_quota=True,user_id='4548c00a7b0049979af0581e126c26e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f5a27be-88fa-4d54-99d3-e4fb9341d5da),volume_type_id=7f5a27be-88fa-4d54-99d3-e4fb9341d5da)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1e1a93-0cf6-4df8-a1a9-a151fd5b64cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1e1a93-0cf6-4df8-a1a9-a151fd5b64cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe0fcc5-690a-48ce-90f7-025382f7f479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe0fcc5-690a-48ce-90f7-025382f7f479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '468b9d13-2efe-4692-b0ac-3925b44513a8', 'volume_name': 'volume-468b9d13-2efe-4692-b0ac-3925b44513a8', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3635bd6b-d31e-4b59-882d-24bee32c640d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3635bd6b-d31e-4b59-882d-24bee32c640d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de708625-b1f1-4b93-9811-22af0a88d70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:36 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume 468b9d13-2efe-4692-b0ac-3925b44513a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-468b9d13-2efe-4692-b0ac-3925b44513a8', 'volume_size': 1}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-994316096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468b9d13-2efe-4692-b0ac-3925b44513a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ec3735ba264bfc9621721989a35926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:38:35Z,use_quota=True,user_id='4548c00a7b0049979af0581e126c26e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f5a27be-88fa-4d54-99d3-e4fb9341d5da),volume_type_id=7f5a27be-88fa-4d54-99d3-e4fb9341d5da)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Creating volume 468b9d13-2efe-4692-b0ac-3925b44513a8 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:38:36 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-468b9d13-2efe-4692-b0ac-3925b44513a8 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:36 devstack quobyte-client[84065]: System call of process 98376 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:38:36 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=119, name=volume-468b9d13-2efe-4692-b0ac-3925b44513a8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63814ae3-5233-4fd2-a65c-1822b206a947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b9b77ca-c119-4554-a18a-d890b0b96e75', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41c2a695-4763-41df-b99c-36a71f4637db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:36 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Flow 'volume_create_manager' (b196d37d-6c4c-4625-9255-530199e395f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8925237f-77b7-44e6-9a06-e77045b16e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:36 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume volume-3b9b77ca-c119-4554-a18a-d890b0b96e75 (3b9b77ca-c119-4554-a18a-d890b0b96e75): created successfully
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41c2a695-4763-41df-b99c-36a71f4637db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Flow 'volume_create_manager' (4ca706af-beec-4861-b49b-8052b02d8e30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-468b9d13-2efe-4692-b0ac-3925b44513a8 1073741824" returned: 0 in 0.701s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-468b9d13-2efe-4692-b0ac-3925b44513a8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8925237f-77b7-44e6-9a06-e77045b16e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1149416503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2dcf1b0-b31e-4664-944c-d62c6642253d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ec3735ba264bfc9621721989a35926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:38:36Z,use_quota=True,user_id='4548c00a7b0049979af0581e126c26e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1303aaad-470b-4389-94be-e50a8189a586),volume_type_id=1303aaad-470b-4389-94be-e50a8189a586)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea11b2d6-1b31-4b6c-89e4-b7d2188ffab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea11b2d6-1b31-4b6c-89e4-b7d2188ffab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2149c07-7629-4c2e-ac10-891cfb2393b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:37 devstack cinder-volume[84012]: DEBUG cinder.image.glance [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Creating Keystone auth plugin from conf {{(pid=84012) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 22 23:38:37 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-be37147b-314b-42d8-88f3-25cbe82279ef tempest-TestInstancesWithCinderVolumes-1552423179 None] Created volume successfully.
Sep 22 23:38:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-468b9d13-2efe-4692-b0ac-3925b44513a8" returned: 0 in 0.543s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] <== create_volume: return (1271ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:38:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:38:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de708625-b1f1-4b93-9811-22af0a88d70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-468b9d13-2efe-4692-b0ac-3925b44513a8', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852110dd-1c44-4878-8604-6663863e72b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:37 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume volume-468b9d13-2efe-4692-b0ac-3925b44513a8 (468b9d13-2efe-4692-b0ac-3925b44513a8): created successfully
Sep 22 23:38:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852110dd-1c44-4878-8604-6663863e72b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Flow 'volume_create_manager' (9d032f0d-63ec-438e-9c12-ef4a49a2e83f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:38:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2149c07-7629-4c2e-ac10-891cfb2393b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f2dcf1b0-b31e-4664-944c-d62c6642253d', 'volume_name': 'volume-f2dcf1b0-b31e-4664-944c-d62c6642253d', 'volume_size': 1, 'image_id': 'e2a4f8e7-6458-47f7-8738-b482137a627e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2a4f8e7-6458-47f7-8738-b482137a627e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1711914195', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '68ec3735ba264bfc9621721989a35926', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2a4f8e7-6458-47f7-8738-b482137a627e', 'created_at': datetime.datetime(2025, 9, 22, 21, 38, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 21, 38, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2a4f8e7-6458-47f7-8738-b482137a627e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0d05503d30>}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5e71ca-4edf-4278-b5aa-b486008c0aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5e71ca-4edf-4278-b5aa-b486008c0aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fd4f1f-f426-4a9c-9c97-f249f89e2022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:37 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume f2dcf1b0-b31e-4664-944c-d62c6642253d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f2dcf1b0-b31e-4664-944c-d62c6642253d', 'volume_size': 1, 'image_id': 'e2a4f8e7-6458-47f7-8738-b482137a627e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2a4f8e7-6458-47f7-8738-b482137a627e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1711914195', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '68ec3735ba264bfc9621721989a35926', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2a4f8e7-6458-47f7-8738-b482137a627e', 'created_at': datetime.datetime(2025, 9, 22, 21, 38, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 21, 38, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2a4f8e7-6458-47f7-8738-b482137a627e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0d05503d30>}
Sep 22 23:38:37 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Cloning f2dcf1b0-b31e-4664-944c-d62c6642253d from image e2a4f8e7-6458-47f7-8738-b482137a627e  at location (None, [{'url': 'file:///opt/stack/data/glance/images/e2a4f8e7-6458-47f7-8738-b482137a627e', 'metadata': {}}]). {{(pid=84012) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 22 23:38:37 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-54844584-5199-4f7a-b2a7-cc2128307933 tempest-TestInstancesWithCinderVolumes-1552423179 None] Created volume successfully.
Sep 22 23:38:40 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e2a4f8e7-6458-47f7-8738-b482137a627e_oh95qys4devstack@QuobyteHD, size 20.69 MB, duration 2.47 sec {{(pid=84012) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 22 23:38:40 devstack cinder-volume[84012]: INFO cinder.image.image_utils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Image download 20.69 MB at 8.37 MB/s
Sep 22 23:38:40 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1453348e-4364-4114-b5e6-4228014536e5]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:38:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a4f8e7-6458-47f7-8738-b482137a627e_oh95qys4devstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:41 devstack sudo[98381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a4f8e7-6458-47f7-8738-b482137a627e_oh95qys4devstack@QuobyteHD
Sep 22 23:38:41 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:38:43 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root
Sep 22 23:38:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a4f8e7-6458-47f7-8738-b482137a627e_oh95qys4devstack@QuobyteHD" returned: 0 in 2.764s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:43 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Temporary image e2a4f8e7-6458-47f7-8738-b482137a627e is fetched for user 4548c00a7b0049979af0581e126c26e4. {{(pid=84012) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 22 23:38:43 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd0c0c1-de49-4c9a-8871-1d64d18d20a1]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:38:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a4f8e7-6458-47f7-8738-b482137a627e_oh95qys4devstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:43 devstack sudo[98386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a4f8e7-6458-47f7-8738-b482137a627e_oh95qys4devstack@QuobyteHD
Sep 22 23:38:43 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:38:45 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root
Sep 22 23:38:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a4f8e7-6458-47f7-8738-b482137a627e_oh95qys4devstack@QuobyteHD" returned: 0 in 2.252s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:38:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:38:45 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1149416503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2dcf1b0-b31e-4664-944c-d62c6642253d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ec3735ba264bfc9621721989a35926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:38:36Z,use_quota=True,user_id='4548c00a7b0049979af0581e126c26e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1303aaad-470b-4389-94be-e50a8189a586),volume_type_id=1303aaad-470b-4389-94be-e50a8189a586)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:38:45 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Creating volume f2dcf1b0-b31e-4664-944c-d62c6642253d {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:38:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:38:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:38:45 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:38:45 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:38:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:38:45 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:38:45 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:38:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:46 devstack quobyte-client[84065]: System call of process 98392 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:38:46 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=120, name=volume-f2dcf1b0-b31e-4664-944c-d62c6642253d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:38:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d 1073741824" returned: 0 in 0.685s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d" returned: 0 in 0.390s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] <== create_volume: return (1162ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:38:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:38:47 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:38:47 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:38:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Flow 'volume_create_manager' (f79fc3ed-013b-47ac-a64f-30d8812cd445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:38:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6fc24c-920f-4a1c-b5ac-04ca44f3a7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6fc24c-920f-4a1c-b5ac-04ca44f3a7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1779464197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9421a512-d802-49f0-a423-e477cb834894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a54247524c14053831c269598061476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:38:46Z,use_quota=True,user_id='d32c19c0974a40a684d8c40e88555cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c4b534-cd3e-4983-98e5-d3db61f21dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c4b534-cd3e-4983-98e5-d3db61f21dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d285827-ae67-4f2b-bc8e-c3f6b8918acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:47 devstack cinder-volume[84012]: DEBUG cinder.image.glance [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Creating Keystone auth plugin from conf {{(pid=84012) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 22 23:38:47 devstack cinder-volume[84012]: DEBUG cinder.volume.volume_utils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Attempting download of e2a4f8e7-6458-47f7-8738-b482137a627e ((None, [{'url': 'file:///opt/stack/data/glance/images/e2a4f8e7-6458-47f7-8738-b482137a627e', 'metadata': {}}])) to volume f2dcf1b0-b31e-4664-944c-d62c6642253d. {{(pid=84012) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 22 23:38:47 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3d7cb5-b34e-4b40-a351-2416e011143d]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:38:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2a4f8e7-6458-47f7-8738-b482137a627e_mk1yy73y {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d285827-ae67-4f2b-bc8e-c3f6b8918acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9421a512-d802-49f0-a423-e477cb834894', 'volume_name': 'volume-9421a512-d802-49f0-a423-e477cb834894', 'volume_size': 1, 'image_id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b1f99fd8595b4e59a87b2ac5fd8513ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'created_at': datetime.datetime(2025, 9, 22, 20, 57, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 20, 57, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0d052e6050>}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175ce8dc-839f-46c3-afde-74f2f3ee6d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175ce8dc-839f-46c3-afde-74f2f3ee6d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:48 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b440baa-768f-46de-a699-b58ea53d79ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:48 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Volume 9421a512-d802-49f0-a423-e477cb834894: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9421a512-d802-49f0-a423-e477cb834894', 'volume_size': 1, 'image_id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b1f99fd8595b4e59a87b2ac5fd8513ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'created_at': datetime.datetime(2025, 9, 22, 20, 57, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 20, 57, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0d052e6050>}
Sep 22 23:38:48 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Cloning 9421a512-d802-49f0-a423-e477cb834894 from image 60f4d0ec-ef65-4fa8-9530-b89728f917ec  at location (None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}]). {{(pid=84012) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 22 23:38:48 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:38:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:38:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:38:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:38:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:38:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:38:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2a4f8e7-6458-47f7-8738-b482137a627e_mk1yy73y" returned: 0 in 0.799s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2a4f8e7-6458-47f7-8738-b482137a627e_mk1yy73y {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.404s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:38:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2a4f8e7-6458-47f7-8738-b482137a627e_mk1yy73y" returned: 1 in 0.543s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2a4f8e7-6458-47f7-8738-b482137a627e_mk1yy73y' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:38:49 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc778cc0-5fe8-44ea-bd18-dc749d0d98d7]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:38:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a4f8e7-6458-47f7-8738-b482137a627e_oh95qys4devstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:49 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_p4l5735zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84012) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 22 23:38:49 devstack cinder-volume[84012]: INFO cinder.image.image_utils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Image download 20.69 MB at 20.66 MB/s
Sep 22 23:38:49 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[74167e4c-4fa3-4520-9253-f5364856f250]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:38:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_p4l5735zdevstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a4f8e7-6458-47f7-8738-b482137a627e_oh95qys4devstack@QuobyteHD" returned: 0 in 0.525s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:49 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] e2a4f8e7-6458-47f7-8738-b482137a627e was qcow2, converting to raw {{(pid=84012) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 22 23:38:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2a4f8e7-6458-47f7-8738-b482137a627e_oh95qys4devstack@QuobyteHD /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:49 devstack quobyte-client[84065]: System call of process 98438 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:38:49 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=120, name=volume-f2dcf1b0-b31e-4664-944c-d62c6642253d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:38:49 devstack sudo[98435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_p4l5735zdevstack@QuobyteHD
Sep 22 23:38:49 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:38:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2a4f8e7-6458-47f7-8738-b482137a627e_oh95qys4devstack@QuobyteHD /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d" returned: 0 in 1.066s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:50 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e2a4f8e7-6458-47f7-8738-b482137a627e_oh95qys4devstack@QuobyteHD, size 112.00 MB, duration 1.10 sec, destination /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d {{(pid=84012) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 22 23:38:50 devstack cinder-volume[84012]: INFO cinder.image.image_utils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Converted 112.00 MB image at 101.70 MB/s
Sep 22 23:38:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d 1G" returned: 0 in 0.187s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:51 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[9580c971-4f15-4425-bf2f-43279028a733]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:38:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:51 devstack quobyte-client[84065]: System call of process 98448 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:38:51 devstack quobyte-client[84065]: System call of process 98448 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:38:51 devstack quobyte-client[84065]: System call of process 98448 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:38:51 devstack quobyte-client[84065]: System call of process 98448 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:38:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d" returned: 0 in 0.657s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:51 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root
Sep 22 23:38:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_p4l5735zdevstack@QuobyteHD" returned: 0 in 2.577s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:52 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Temporary image 60f4d0ec-ef65-4fa8-9530-b89728f917ec is fetched for user d32c19c0974a40a684d8c40e88555cd8. {{(pid=84012) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 22 23:38:52 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe57522-ad84-45fe-b797-45d4cebe14a0]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:38:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_p4l5735zdevstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d" returned: 1 in 0.655s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:38:52 devstack cinder-volume[84012]: DEBUG cinder.volume.volume_utils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Downloaded image e2a4f8e7-6458-47f7-8738-b482137a627e ((None, [{'url': 'file:///opt/stack/data/glance/images/e2a4f8e7-6458-47f7-8738-b482137a627e', 'metadata': {}}])) to volume f2dcf1b0-b31e-4664-944c-d62c6642253d successfully. {{(pid=84012) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 22 23:38:52 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Temporary image e2a4f8e7-6458-47f7-8738-b482137a627e for user 4548c00a7b0049979af0581e126c26e4 is deleted. {{(pid=84012) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 22 23:38:52 devstack cinder-volume[84012]: DEBUG cinder.volume.volume_utils [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Marking volume f2dcf1b0-b31e-4664-944c-d62c6642253d as bootable. {{(pid=84012) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 22 23:38:52 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Copying metadata from image e2a4f8e7-6458-47f7-8738-b482137a627e to f2dcf1b0-b31e-4664-944c-d62c6642253d. {{(pid=84012) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 22 23:38:52 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Creating volume glance metadata for volume f2dcf1b0-b31e-4664-944c-d62c6642253d backed by image e2a4f8e7-6458-47f7-8738-b482137a627e with: {'image_id': 'e2a4f8e7-6458-47f7-8738-b482137a627e', 'image_name': 'tempest-scenario-img--1711914195', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84012) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 22 23:38:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fd4f1f-f426-4a9c-9c97-f249f89e2022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2dcf1b0-b31e-4664-944c-d62c6642253d', 'volume_size': 1, 'image_id': 'e2a4f8e7-6458-47f7-8738-b482137a627e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2a4f8e7-6458-47f7-8738-b482137a627e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1711914195', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '68ec3735ba264bfc9621721989a35926', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2a4f8e7-6458-47f7-8738-b482137a627e', 'created_at': datetime.datetime(2025, 9, 22, 21, 38, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 21, 38, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2a4f8e7-6458-47f7-8738-b482137a627e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0d05503d30>}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89082dbe-c553-440d-9e01-2a208cb66615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:52 devstack sudo[98456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_p4l5735zdevstack@QuobyteHD
Sep 22 23:38:52 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:38:52 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume volume-f2dcf1b0-b31e-4664-944c-d62c6642253d (f2dcf1b0-b31e-4664-944c-d62c6642253d): created successfully
Sep 22 23:38:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89082dbe-c553-440d-9e01-2a208cb66615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Flow 'volume_create_manager' (b196d37d-6c4c-4625-9255-530199e395f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:38:52 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-68675f92-04c4-4096-bc9e-12a27a1b8366 tempest-TestInstancesWithCinderVolumes-1552423179 None] Created volume successfully.
Sep 22 23:38:54 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root
Sep 22 23:38:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_p4l5735zdevstack@QuobyteHD" returned: 0 in 2.291s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:38:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:38:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1779464197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9421a512-d802-49f0-a423-e477cb834894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a54247524c14053831c269598061476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:38:46Z,use_quota=True,user_id='d32c19c0974a40a684d8c40e88555cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:38:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Creating volume 9421a512-d802-49f0-a423-e477cb834894 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:38:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:38:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:38:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:38:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:38:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:38:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:38:54 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:38:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:54 devstack quobyte-client[84065]: System call of process 98461 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:38:54 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=121, name=volume-9421a512-d802-49f0-a423-e477cb834894, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:38:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894 1073741824" returned: 0 in 0.419s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894" returned: 0 in 0.113s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] <== create_volume: return (656ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:38:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:38:55 devstack cinder-volume[84012]: DEBUG cinder.volume.volume_utils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Attempting download of 60f4d0ec-ef65-4fa8-9530-b89728f917ec ((None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}])) to volume 9421a512-d802-49f0-a423-e477cb834894. {{(pid=84012) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 22 23:38:55 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c492ed0-499f-4c75-afda-8276d8e8e68d]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:38:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60f4d0ec-ef65-4fa8-9530-b89728f917ec__g3nurye {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60f4d0ec-ef65-4fa8-9530-b89728f917ec__g3nurye" returned: 0 in 0.385s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60f4d0ec-ef65-4fa8-9530-b89728f917ec__g3nurye {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60f4d0ec-ef65-4fa8-9530-b89728f917ec__g3nurye" returned: 1 in 0.437s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60f4d0ec-ef65-4fa8-9530-b89728f917ec__g3nurye' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:38:56 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7351a3-5ec3-4384-8934-92c8aea61aef]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:38:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_p4l5735zdevstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_p4l5735zdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:57 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] 60f4d0ec-ef65-4fa8-9530-b89728f917ec was qcow2, converting to raw {{(pid=84012) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 22 23:38:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_p4l5735zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:57 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=121, name=volume-9421a512-d802-49f0-a423-e477cb834894, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:38:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_p4l5735zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894" returned: 0 in 0.963s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:58 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_60f4d0ec-ef65-4fa8-9530-b89728f917ec_p4l5735zdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894 {{(pid=84012) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 22 23:38:58 devstack cinder-volume[84012]: INFO cinder.image.image_utils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Converted 112.00 MB image at 112.00 MB/s
Sep 22 23:38:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:58 devstack quobyte-client[84065]: System call of process 98479 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:38:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894 1G" returned: 0 in 0.153s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:58 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b952507f-b366-4ff7-a121-526f9034047d]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:38:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894" returned: 0 in 0.396s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:38:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894" returned: 1 in 0.396s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:38:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:38:59 devstack cinder-volume[84012]: DEBUG cinder.volume.volume_utils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Downloaded image 60f4d0ec-ef65-4fa8-9530-b89728f917ec ((None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}])) to volume 9421a512-d802-49f0-a423-e477cb834894 successfully. {{(pid=84012) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 22 23:38:59 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Temporary image 60f4d0ec-ef65-4fa8-9530-b89728f917ec for user d32c19c0974a40a684d8c40e88555cd8 is deleted. {{(pid=84012) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 22 23:38:59 devstack cinder-volume[84012]: DEBUG cinder.volume.volume_utils [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Marking volume 9421a512-d802-49f0-a423-e477cb834894 as bootable. {{(pid=84012) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 22 23:38:59 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Copying metadata from image 60f4d0ec-ef65-4fa8-9530-b89728f917ec to 9421a512-d802-49f0-a423-e477cb834894. {{(pid=84012) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 22 23:38:59 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Creating volume glance metadata for volume 9421a512-d802-49f0-a423-e477cb834894 backed by image 60f4d0ec-ef65-4fa8-9530-b89728f917ec with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84012) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 22 23:38:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b440baa-768f-46de-a699-b58ea53d79ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9421a512-d802-49f0-a423-e477cb834894', 'volume_size': 1, 'image_id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b1f99fd8595b4e59a87b2ac5fd8513ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '60f4d0ec-ef65-4fa8-9530-b89728f917ec', 'created_at': datetime.datetime(2025, 9, 22, 20, 57, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 20, 57, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60f4d0ec-ef65-4fa8-9530-b89728f917ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0d052e6050>}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23cfe9e6-97a3-4eb1-808d-e4803f2854ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:38:59 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Volume volume-9421a512-d802-49f0-a423-e477cb834894 (9421a512-d802-49f0-a423-e477cb834894): created successfully
Sep 22 23:38:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23cfe9e6-97a3-4eb1-808d-e4803f2854ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:38:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Flow 'volume_create_manager' (f79fc3ed-013b-47ac-a64f-30d8812cd445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:38:59 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-a93c7cc5-c914-474f-bb27-d9083aef9a23 tempest-TestShelveInstance-339570751 None] Created volume successfully.
Sep 22 23:39:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-7cef325a-d24f-4cc3-af4f-a117f37e5b07 req-3e40c2b1-4c1a-4a16-916b-707ce3fd6469 tempest-TestInstancesWithCinderVolumes-1552423179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:39:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-7cef325a-d24f-4cc3-af4f-a117f37e5b07 req-3e40c2b1-4c1a-4a16-916b-707ce3fd6469 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:39:02 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[68af0e48-af01-45a6-bce1-c63da93ee022]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:39:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-7cef325a-d24f-4cc3-af4f-a117f37e5b07 req-3e40c2b1-4c1a-4a16-916b-707ce3fd6469 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:39:03 devstack quobyte-client[84065]: System call of process 98502 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:39:03 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-7cef325a-d24f-4cc3-af4f-a117f37e5b07 req-3e40c2b1-4c1a-4a16-916b-707ce3fd6469 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d" returned: 0 in 0.549s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:39:03 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-7cef325a-d24f-4cc3-af4f-a117f37e5b07 req-3e40c2b1-4c1a-4a16-916b-707ce3fd6469 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:39:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-7cef325a-d24f-4cc3-af4f-a117f37e5b07 req-3e40c2b1-4c1a-4a16-916b-707ce3fd6469 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d" returned: 1 in 0.418s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:39:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-7cef325a-d24f-4cc3-af4f-a117f37e5b07 req-3e40c2b1-4c1a-4a16-916b-707ce3fd6469 tempest-TestInstancesWithCinderVolumes-1552423179 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:39:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-7cef325a-d24f-4cc3-af4f-a117f37e5b07 req-3e40c2b1-4c1a-4a16-916b-707ce3fd6469 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.145s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:39:04 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-7cef325a-d24f-4cc3-af4f-a117f37e5b07 req-3e40c2b1-4c1a-4a16-916b-707ce3fd6469 tempest-TestInstancesWithCinderVolumes-1552423179 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-f2dcf1b0-b31e-4664-944c-d62c6642253d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5cac07a-69cb-4001-8858-d54bef1ff620', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:39:04 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-7cef325a-d24f-4cc3-af4f-a117f37e5b07 req-3e40c2b1-4c1a-4a16-916b-707ce3fd6469 tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:39:04 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-7cef325a-d24f-4cc3-af4f-a117f37e5b07 req-3e40c2b1-4c1a-4a16-916b-707ce3fd6469 tempest-TestInstancesWithCinderVolumes-1552423179 None] attachment_update completed successfully.
Sep 22 23:39:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-4970041e-345f-4882-8196-d5ab507f778c req-c5bb2f4b-227e-4412-a7af-ae5593107933 tempest-TestShelveInstance-339570751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:39:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-4970041e-345f-4882-8196-d5ab507f778c req-c5bb2f4b-227e-4412-a7af-ae5593107933 tempest-TestShelveInstance-339570751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:39:11 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5230c094-b364-4487-8ef1-9eeb79e66e7f]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:39:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-4970041e-345f-4882-8196-d5ab507f778c req-c5bb2f4b-227e-4412-a7af-ae5593107933 tempest-TestShelveInstance-339570751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:39:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-4970041e-345f-4882-8196-d5ab507f778c req-c5bb2f4b-227e-4412-a7af-ae5593107933 tempest-TestShelveInstance-339570751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894" returned: 0 in 0.453s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:39:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-4970041e-345f-4882-8196-d5ab507f778c req-c5bb2f4b-227e-4412-a7af-ae5593107933 tempest-TestShelveInstance-339570751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:39:12 devstack quobyte-client[84065]: System call of process 98910 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:39:12 devstack quobyte-client[84065]: System call of process 98910 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:39:12 devstack quobyte-client[84065]: System call of process 98910 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:39:12 devstack quobyte-client[84065]: System call of process 98910 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:39:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-4970041e-345f-4882-8196-d5ab507f778c req-c5bb2f4b-227e-4412-a7af-ae5593107933 tempest-TestShelveInstance-339570751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894" returned: 1 in 0.629s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:39:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-4970041e-345f-4882-8196-d5ab507f778c req-c5bb2f4b-227e-4412-a7af-ae5593107933 tempest-TestShelveInstance-339570751 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:39:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-4970041e-345f-4882-8196-d5ab507f778c req-c5bb2f4b-227e-4412-a7af-ae5593107933 tempest-TestShelveInstance-339570751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.620s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:39:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-4970041e-345f-4882-8196-d5ab507f778c req-c5bb2f4b-227e-4412-a7af-ae5593107933 tempest-TestShelveInstance-339570751 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-9421a512-d802-49f0-a423-e477cb834894', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '124f70ee-720c-4190-8cf9-c688525b0d03', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:39:12 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-4970041e-345f-4882-8196-d5ab507f778c req-c5bb2f4b-227e-4412-a7af-ae5593107933 tempest-TestShelveInstance-339570751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:39:13 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-4970041e-345f-4882-8196-d5ab507f778c req-c5bb2f4b-227e-4412-a7af-ae5593107933 tempest-TestShelveInstance-339570751 None] attachment_update completed successfully.
Sep 22 23:39:23 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=14,cinder:SELECT=31,cinder:DELETE=3,cinder:INSERT=11 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:39:23 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=25,cinder:UPDATE=14,cinder:INSERT=11,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:39:48 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:39:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:39:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:39:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:39:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:39:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.064s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:39:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:39:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.261s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:39:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:40:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-fa454722-9d7d-4c26-a2bb-f0c09e10e399 req-342cae1c-21ee-4927-b307-0b643b96cc59 tempest-TestInstancesWithCinderVolumes-1552423179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:40:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-fa454722-9d7d-4c26-a2bb-f0c09e10e399 req-342cae1c-21ee-4927-b307-0b643b96cc59 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:40:28 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[772b851e-f2d1-4617-a475-425a334706c2]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:40:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-fa454722-9d7d-4c26-a2bb-f0c09e10e399 req-342cae1c-21ee-4927-b307-0b643b96cc59 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3b9b77ca-c119-4554-a18a-d890b0b96e75 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:40:28 devstack quobyte-client[84065]: System call of process 99218 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:40:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-fa454722-9d7d-4c26-a2bb-f0c09e10e399 req-342cae1c-21ee-4927-b307-0b643b96cc59 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3b9b77ca-c119-4554-a18a-d890b0b96e75" returned: 0 in 0.654s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:40:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-fa454722-9d7d-4c26-a2bb-f0c09e10e399 req-342cae1c-21ee-4927-b307-0b643b96cc59 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.780s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:40:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-fa454722-9d7d-4c26-a2bb-f0c09e10e399 req-342cae1c-21ee-4927-b307-0b643b96cc59 tempest-TestInstancesWithCinderVolumes-1552423179 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-3b9b77ca-c119-4554-a18a-d890b0b96e75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da840599-4a0b-4984-8391-1117f342b739', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:40:29 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-fa454722-9d7d-4c26-a2bb-f0c09e10e399 req-342cae1c-21ee-4927-b307-0b643b96cc59 tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:40:29 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-fa454722-9d7d-4c26-a2bb-f0c09e10e399 req-342cae1c-21ee-4927-b307-0b643b96cc59 tempest-TestInstancesWithCinderVolumes-1552423179 None] attachment_update completed successfully.
Sep 22 23:40:39 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:40:39 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:40:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-e1d0ba54-9853-4aca-ad63-79c97c14fea3 req-5541d9d6-8417-4e16-98e0-a2a6d67aeb94 tempest-TestInstancesWithCinderVolumes-1552423179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:40:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-e1d0ba54-9853-4aca-ad63-79c97c14fea3 req-5541d9d6-8417-4e16-98e0-a2a6d67aeb94 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:40:41 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[824411c9-5ef1-476b-bbd6-89ecd05a7cda]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:40:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-e1d0ba54-9853-4aca-ad63-79c97c14fea3 req-5541d9d6-8417-4e16-98e0-a2a6d67aeb94 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-468b9d13-2efe-4692-b0ac-3925b44513a8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:40:42 devstack quobyte-client[84065]: System call of process 99322 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:40:42 devstack quobyte-client[84065]: System call of process 99322 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:40:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-e1d0ba54-9853-4aca-ad63-79c97c14fea3 req-5541d9d6-8417-4e16-98e0-a2a6d67aeb94 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-468b9d13-2efe-4692-b0ac-3925b44513a8" returned: 0 in 0.954s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:40:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-e1d0ba54-9853-4aca-ad63-79c97c14fea3 req-5541d9d6-8417-4e16-98e0-a2a6d67aeb94 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.099s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:40:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-e1d0ba54-9853-4aca-ad63-79c97c14fea3 req-5541d9d6-8417-4e16-98e0-a2a6d67aeb94 tempest-TestInstancesWithCinderVolumes-1552423179 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-468b9d13-2efe-4692-b0ac-3925b44513a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf8695d2-6530-4244-b12d-fb7bd20d2826', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:40:42 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-e1d0ba54-9853-4aca-ad63-79c97c14fea3 req-5541d9d6-8417-4e16-98e0-a2a6d67aeb94 tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:40:42 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-e1d0ba54-9853-4aca-ad63-79c97c14fea3 req-5541d9d6-8417-4e16-98e0-a2a6d67aeb94 tempest-TestInstancesWithCinderVolumes-1552423179 None] attachment_update completed successfully.
Sep 22 23:40:44 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-fdb351b0-3fcc-4519-9026-198444091a70 req-0291a64b-f22d-4585-9889-157626f2216f tempest-TestShelveInstance-339570751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:40:44 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-fdb351b0-3fcc-4519-9026-198444091a70 req-0291a64b-f22d-4585-9889-157626f2216f tempest-TestShelveInstance-339570751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:40:44 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-fdb351b0-3fcc-4519-9026-198444091a70 req-0291a64b-f22d-4585-9889-157626f2216f tempest-TestShelveInstance-339570751 None] Terminate volume connection completed successfully.
Sep 22 23:40:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-fdb351b0-3fcc-4519-9026-198444091a70 req-0291a64b-f22d-4585-9889-157626f2216f tempest-TestShelveInstance-339570751 None] Deleting attachment 124f70ee-720c-4190-8cf9-c688525b0d03. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:40:48 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:40:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:40:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:40:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:40:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:40:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:40:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:40:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.123s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:40:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:40:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-9f681ebd-6e01-4551-9b56-a977a927f56c req-65de9468-6002-4d52-91df-485d6ab33c26 tempest-TestShelveInstance-339570751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:40:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-9f681ebd-6e01-4551-9b56-a977a927f56c req-65de9468-6002-4d52-91df-485d6ab33c26 tempest-TestShelveInstance-339570751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:40:50 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7183a0eb-ffdf-4683-8882-9177bc37a197]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:40:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-9f681ebd-6e01-4551-9b56-a977a927f56c req-65de9468-6002-4d52-91df-485d6ab33c26 tempest-TestShelveInstance-339570751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:40:51 devstack quobyte-client[84065]: System call of process 99387 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:40:51 devstack quobyte-client[84065]: System call of process 99387 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:40:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-9f681ebd-6e01-4551-9b56-a977a927f56c req-65de9468-6002-4d52-91df-485d6ab33c26 tempest-TestShelveInstance-339570751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894" returned: 0 in 0.611s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:40:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-9f681ebd-6e01-4551-9b56-a977a927f56c req-65de9468-6002-4d52-91df-485d6ab33c26 tempest-TestShelveInstance-339570751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:40:51 devstack quobyte-client[84065]: System call of process 99409 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:40:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-9f681ebd-6e01-4551-9b56-a977a927f56c req-65de9468-6002-4d52-91df-485d6ab33c26 tempest-TestShelveInstance-339570751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894" returned: 1 in 0.668s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:40:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-9f681ebd-6e01-4551-9b56-a977a927f56c req-65de9468-6002-4d52-91df-485d6ab33c26 tempest-TestShelveInstance-339570751 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:40:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-9f681ebd-6e01-4551-9b56-a977a927f56c req-65de9468-6002-4d52-91df-485d6ab33c26 tempest-TestShelveInstance-339570751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.486s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:40:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-9f681ebd-6e01-4551-9b56-a977a927f56c req-65de9468-6002-4d52-91df-485d6ab33c26 tempest-TestShelveInstance-339570751 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-9421a512-d802-49f0-a423-e477cb834894', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a9d6a05-50a0-43f9-9f04-fd861eaaa69f', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:40:52 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-9f681ebd-6e01-4551-9b56-a977a927f56c req-65de9468-6002-4d52-91df-485d6ab33c26 tempest-TestShelveInstance-339570751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:40:52 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-9f681ebd-6e01-4551-9b56-a977a927f56c req-65de9468-6002-4d52-91df-485d6ab33c26 tempest-TestShelveInstance-339570751 None] attachment_update completed successfully.
Sep 22 23:41:02 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=12,cinder:UPDATE=2 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:41:02 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:41:18 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-4950a346-e03e-4403-b52e-896116e5299a req-3fc25472-7880-45c6-85d3-b0309cb5ae6b tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:41:18 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-4950a346-e03e-4403-b52e-896116e5299a req-3fc25472-7880-45c6-85d3-b0309cb5ae6b tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:41:18 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-4950a346-e03e-4403-b52e-896116e5299a req-3fc25472-7880-45c6-85d3-b0309cb5ae6b tempest-TestInstancesWithCinderVolumes-1552423179 None] Terminate volume connection completed successfully.
Sep 22 23:41:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-4950a346-e03e-4403-b52e-896116e5299a req-3fc25472-7880-45c6-85d3-b0309cb5ae6b tempest-TestInstancesWithCinderVolumes-1552423179 None] Deleting attachment da840599-4a0b-4984-8391-1117f342b739. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:41:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] Acquiring lock "cinder-3b9b77ca-c119-4554-a18a-d890b0b96e75-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:41:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "cinder-3b9b77ca-c119-4554-a18a-d890b0b96e75-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:41:20 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:41:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] Acquiring lock "cinder-quobyte-3b9b77ca-c119-4554-a18a-d890b0b96e75" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:41:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "cinder-quobyte-3b9b77ca-c119-4554-a18a-d890b0b96e75" acquired by "delete_volume" :: waited 0.016s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:41:20 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[580db5e1-1988-4d15-853f-3813c32d11cc]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:41:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3b9b77ca-c119-4554-a18a-d890b0b96e75 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:41:20 devstack quobyte-client[84065]: System call of process 99536 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:41:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3b9b77ca-c119-4554-a18a-d890b0b96e75" returned: 0 in 0.539s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:41:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3b9b77ca-c119-4554-a18a-d890b0b96e75 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:41:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-3b9b77ca-c119-4554-a18a-d890b0b96e75" returned: 0 in 0.130s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:41:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "cinder-quobyte-3b9b77ca-c119-4554-a18a-d890b0b96e75" released by "delete_volume" :: held 0.841s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:41:21 devstack cinder-volume[84012]: WARNING cinder.quota [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1086364036-1701354503 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1086364036-1701354503, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:41:21 devstack cinder-volume[84012]: WARNING cinder.quota [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1086364036-1701354503 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1086364036-1701354503, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:41:21 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] Created reservations ['dc715689-a5f4-45d3-81e3-4e734921faf7', '14b3624d-7836-468e-8bd1-d1ea22388ee8', '32414e41-b00f-4098-b5b9-74114cc6b212', '81a9a20d-9327-4208-8074-a50f2c98072c'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:41:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:41:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:41:21 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:41:21 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:41:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:41:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:41:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.115s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:41:21 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:41:21 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] Deleted volume successfully.
Sep 22 23:41:21 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d0f95cbc-7282-465e-986c-7cddef615d52 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "cinder-3b9b77ca-c119-4554-a18a-d890b0b96e75-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:41:31 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:41:31 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=12,cinder:SELECT=6,cinder:INSERT=3,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:41:49 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-b7e1c681-92fa-4c89-a5ee-17ce3abc514c req-33fdd890-a9a1-4d58-8c03-3692413a927f tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:41:49 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-b7e1c681-92fa-4c89-a5ee-17ce3abc514c req-33fdd890-a9a1-4d58-8c03-3692413a927f tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:41:49 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-b7e1c681-92fa-4c89-a5ee-17ce3abc514c req-33fdd890-a9a1-4d58-8c03-3692413a927f tempest-TestInstancesWithCinderVolumes-1552423179 None] Terminate volume connection completed successfully.
Sep 22 23:41:49 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-b7e1c681-92fa-4c89-a5ee-17ce3abc514c req-33fdd890-a9a1-4d58-8c03-3692413a927f tempest-TestInstancesWithCinderVolumes-1552423179 None] Deleting attachment cf8695d2-6530-4244-b12d-fb7bd20d2826. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:41:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] Acquiring lock "cinder-468b9d13-2efe-4692-b0ac-3925b44513a8-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:41:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "cinder-468b9d13-2efe-4692-b0ac-3925b44513a8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:41:50 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:41:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] Acquiring lock "cinder-quobyte-468b9d13-2efe-4692-b0ac-3925b44513a8" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:41:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "cinder-quobyte-468b9d13-2efe-4692-b0ac-3925b44513a8" acquired by "delete_volume" :: waited 0.016s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:41:50 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[febe8995-3672-4dab-92dd-49606fbd5ad2]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:41:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-468b9d13-2efe-4692-b0ac-3925b44513a8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:41:51 devstack quobyte-client[84065]: System call of process 99610 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:41:51 devstack quobyte-client[84065]: System call of process 99610 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:41:51 devstack quobyte-client[84065]: System call of process 99610 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:41:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-468b9d13-2efe-4692-b0ac-3925b44513a8" returned: 0 in 0.606s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:41:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-468b9d13-2efe-4692-b0ac-3925b44513a8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:41:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-468b9d13-2efe-4692-b0ac-3925b44513a8" returned: 0 in 0.268s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:41:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "cinder-quobyte-468b9d13-2efe-4692-b0ac-3925b44513a8" released by "delete_volume" :: held 1.288s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:41:52 devstack cinder-volume[84012]: WARNING cinder.quota [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-321221753-1553721739 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-321221753-1553721739, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:41:52 devstack cinder-volume[84012]: WARNING cinder.quota [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-321221753-1553721739 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-321221753-1553721739, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:41:52 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] Created reservations ['3cb24046-caeb-443f-bd45-bb0ad1571338', '25392056-65e5-42d5-9449-a62b25be1f5a', 'ffc6263e-58ff-467a-8247-ab76c5f76bc1', 'a3d16aa4-00ad-483b-9349-215447a0e23e'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:41:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:41:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:41:53 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:41:53 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:41:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:41:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:41:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.132s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:41:53 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:41:53 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] Deleted volume successfully.
Sep 22 23:41:53 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2ecf3d3b-61b7-46aa-bd22-4d5fd1ea3486 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "cinder-468b9d13-2efe-4692-b0ac-3925b44513a8-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:42:03 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-ccb1225a-6544-4a4c-858a-1525863cda82 req-dea56a7d-8245-4d34-95d8-34b4d06ed5db tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:42:03 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:42:03 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-ccb1225a-6544-4a4c-858a-1525863cda82 req-dea56a7d-8245-4d34-95d8-34b4d06ed5db tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:42:03 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-ccb1225a-6544-4a4c-858a-1525863cda82 req-dea56a7d-8245-4d34-95d8-34b4d06ed5db tempest-TestInstancesWithCinderVolumes-1552423179 None] Terminate volume connection completed successfully.
Sep 22 23:42:03 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-ccb1225a-6544-4a4c-858a-1525863cda82 req-dea56a7d-8245-4d34-95d8-34b4d06ed5db tempest-TestInstancesWithCinderVolumes-1552423179 None] Deleting attachment d5cac07a-69cb-4001-8858-d54bef1ff620. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:42:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] Acquiring lock "cinder-f2dcf1b0-b31e-4664-944c-d62c6642253d-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:42:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "cinder-f2dcf1b0-b31e-4664-944c-d62c6642253d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:42:07 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:42:07 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] Acquiring lock "cinder-quobyte-f2dcf1b0-b31e-4664-944c-d62c6642253d" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:42:07 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "cinder-quobyte-f2dcf1b0-b31e-4664-944c-d62c6642253d" acquired by "delete_volume" :: waited 0.014s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:42:07 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb96595c-1190-4e2a-be9f-63ca3d9863b1]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:42:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:42:07 devstack quobyte-client[84065]: System call of process 99751 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:42:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d" returned: 0 in 0.455s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:42:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:42:08 devstack quobyte-client[84065]: System call of process 99753 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:42:08 devstack quobyte-client[84065]: System call of process 99753 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:42:08 devstack quobyte-client[84065]: System call of process 99753 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:42:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d" returned: 1 in 0.461s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:42:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:42:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:42:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f2dcf1b0-b31e-4664-944c-d62c6642253d" returned: 0 in 0.107s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:42:08 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "cinder-quobyte-f2dcf1b0-b31e-4664-944c-d62c6642253d" released by "delete_volume" :: held 1.280s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:42:08 devstack cinder-volume[84012]: WARNING cinder.quota [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-838208119-996103165 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-838208119-996103165, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:42:08 devstack cinder-volume[84012]: WARNING cinder.quota [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-838208119-996103165 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-838208119-996103165, it is now deprecated. Please use the default quota class for default quota.
Sep 22 23:42:08 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] Created reservations ['2ac78a2e-5151-48b0-bcd8-ad86a3aa5117', 'a36088a2-1ad6-4790-9ff0-b7c5f45c11e3', 'c130d70d-2c5c-48cc-8ca6-615e4bef630d', '11164a21-bc09-4af9-84bb-3742278bdbf3'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:42:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:42:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:42:08 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:42:08 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:42:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:42:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:42:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.091s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:42:08 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:42:08 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] Deleted volume successfully.
Sep 22 23:42:09 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9683e79b-cf04-4035-9df6-49efb9e55bb0 tempest-TestInstancesWithCinderVolumes-1552423179 None] Lock "cinder-f2dcf1b0-b31e-4664-944c-d62c6642253d-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:42:18 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=12,cinder:INSERT=6,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:42:19 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:42:22 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-3c35efef-621f-487a-8981-cd2f8f668213 req-871d443a-cbf2-47b1-808c-e0862b9b0131 tempest-TestShelveInstance-339570751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:42:22 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-3c35efef-621f-487a-8981-cd2f8f668213 req-871d443a-cbf2-47b1-808c-e0862b9b0131 tempest-TestShelveInstance-339570751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:42:22 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-3c35efef-621f-487a-8981-cd2f8f668213 req-871d443a-cbf2-47b1-808c-e0862b9b0131 tempest-TestShelveInstance-339570751 None] Terminate volume connection completed successfully.
Sep 22 23:42:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-3c35efef-621f-487a-8981-cd2f8f668213 req-871d443a-cbf2-47b1-808c-e0862b9b0131 tempest-TestShelveInstance-339570751 None] Deleting attachment 6a9d6a05-50a0-43f9-9f04-fd861eaaa69f. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:42:23 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] Acquiring lock "cinder-9421a512-d802-49f0-a423-e477cb834894-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:42:23 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] Lock "cinder-9421a512-d802-49f0-a423-e477cb834894-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:42:23 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:42:23 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] Acquiring lock "cinder-quobyte-9421a512-d802-49f0-a423-e477cb834894" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:42:23 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] Lock "cinder-quobyte-9421a512-d802-49f0-a423-e477cb834894" acquired by "delete_volume" :: waited 0.014s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:42:23 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1339b8ab-831f-44ba-b73a-881a774d6daf]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:42:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:42:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894" returned: 0 in 0.926s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:42:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:42:24 devstack quobyte-client[84065]: System call of process 99810 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:42:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894" returned: 1 in 0.429s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:42:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:42:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:42:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-9421a512-d802-49f0-a423-e477cb834894" returned: 0 in 0.092s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:42:25 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] Lock "cinder-quobyte-9421a512-d802-49f0-a423-e477cb834894" released by "delete_volume" :: held 1.762s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:42:25 devstack cinder-volume[84012]: DEBUG cinder.quota [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] Created reservations ['bab71ba4-a38f-48b2-9ffc-380d88951f6b', '920a57b6-f3d7-426a-9a73-1791d7b555ee', '3bd9d178-cf8b-4191-bd1a-f01d2ef5af34', 'ffc82f2e-d5e8-4a36-ae19-e60635254336'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:42:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:42:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:42:25 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:42:25 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:42:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:42:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:42:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.098s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:42:25 devstack cinder-volume[84012]: DEBUG cinder.manager [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:42:25 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] Deleted volume successfully.
Sep 22 23:42:26 devstack cinder-volume[84012]: DEBUG cinder.coordination [req-3c35efef-621f-487a-8981-cd2f8f668213 req-14bb501e-5f09-4831-b8ae-85a63cf45171 tempest-TestShelveInstance-339570751 None] Lock "cinder-9421a512-d802-49f0-a423-e477cb834894-delete_volume" released by "delete_volume" :: held 3.063s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:42:35 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=9,cinder:UPDATE=12 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:42:35 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=4,cinder:UPDATE=5,cinder:INSERT=4,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:42:48 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:42:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:42:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:42:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:42:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:42:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:42:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:42:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.111s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:42:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:43:20 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:43:20 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:43:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Flow 'volume_create_manager' (183f7bc4-ce2b-4d2e-bda3-4ec637f6b227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:43:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb553d5-eccc-4c83-a28e-ab9bdda35b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:43:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb553d5-eccc-4c83-a28e-ab9bdda35b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1107576011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9ded21-9670-4edd-8e03-49abf1e9fd9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5efb2eeb1f8b4b37a8845c25cf18e1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:43:21Z,use_quota=True,user_id='3d3037e77662472bb80e9b5c976c3c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:43:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e46f2fa-d11c-4718-b87d-9503ecac11cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:43:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e46f2fa-d11c-4718-b87d-9503ecac11cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:43:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5862369d-8034-4941-8802-57780942fbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:43:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5862369d-8034-4941-8802-57780942fbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d9ded21-9670-4edd-8e03-49abf1e9fd9d', 'volume_name': 'volume-5d9ded21-9670-4edd-8e03-49abf1e9fd9d', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:43:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (550db99d-673f-4390-926e-c2370c63ab4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:43:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (550db99d-673f-4390-926e-c2370c63ab4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:43:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b5a5b9-c31e-4bb0-b772-70b1b19fc934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:43:20 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Volume 5d9ded21-9670-4edd-8e03-49abf1e9fd9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d9ded21-9670-4edd-8e03-49abf1e9fd9d', 'volume_size': 1}
Sep 22 23:43:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:43:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:43:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1107576011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9ded21-9670-4edd-8e03-49abf1e9fd9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5efb2eeb1f8b4b37a8845c25cf18e1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:43:21Z,use_quota=True,user_id='3d3037e77662472bb80e9b5c976c3c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:43:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Creating volume 5d9ded21-9670-4edd-8e03-49abf1e9fd9d {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:43:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:43:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:43:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:43:21 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:43:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:43:21 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:43:21 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:43:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d9ded21-9670-4edd-8e03-49abf1e9fd9d 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:43:21 devstack quobyte-client[84065]: System call of process 99985 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:43:21 devstack quobyte-client[84065]: System call of process 99985 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:43:21 devstack quobyte-client[84065]: System call of process 99985 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:43:21 devstack quobyte-client[84065]: System call of process 99985 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:43:21 devstack quobyte-client[84065]: System call of process 99985 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:43:21 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=122, name=volume-5d9ded21-9670-4edd-8e03-49abf1e9fd9d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:43:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d9ded21-9670-4edd-8e03-49abf1e9fd9d 1073741824" returned: 0 in 0.367s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:43:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d9ded21-9670-4edd-8e03-49abf1e9fd9d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:43:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d9ded21-9670-4edd-8e03-49abf1e9fd9d" returned: 0 in 0.124s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:43:21 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] <== create_volume: return (569ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:43:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.582s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:43:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b5a5b9-c31e-4bb0-b772-70b1b19fc934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d9ded21-9670-4edd-8e03-49abf1e9fd9d', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:43:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2356ca6-27c7-402c-bd1f-db83454ac217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:43:21 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Volume volume-5d9ded21-9670-4edd-8e03-49abf1e9fd9d (5d9ded21-9670-4edd-8e03-49abf1e9fd9d): created successfully
Sep 22 23:43:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2356ca6-27c7-402c-bd1f-db83454ac217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:43:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Flow 'volume_create_manager' (183f7bc4-ce2b-4d2e-bda3-4ec637f6b227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:43:21 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-e75911af-101c-4e69-99a2-e6ec0e3331be tempest-TestMinimumBasicScenario-1673508297 None] Created volume successfully.
Sep 22 23:43:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-9e5d6fad-455b-4d5a-bb2d-4ae910c080f0 req-e533a909-0eaa-4c2c-a9da-a171658c09c0 tempest-TestMinimumBasicScenario-1673508297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:43:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-9e5d6fad-455b-4d5a-bb2d-4ae910c080f0 req-e533a909-0eaa-4c2c-a9da-a171658c09c0 tempest-TestMinimumBasicScenario-1673508297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:43:26 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ef2e89-7f6f-4b2d-8e05-870a5f079c16]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:43:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-9e5d6fad-455b-4d5a-bb2d-4ae910c080f0 req-e533a909-0eaa-4c2c-a9da-a171658c09c0 tempest-TestMinimumBasicScenario-1673508297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d9ded21-9670-4edd-8e03-49abf1e9fd9d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:43:27 devstack quobyte-client[84065]: System call of process 100000 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:43:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [req-9e5d6fad-455b-4d5a-bb2d-4ae910c080f0 req-e533a909-0eaa-4c2c-a9da-a171658c09c0 tempest-TestMinimumBasicScenario-1673508297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d9ded21-9670-4edd-8e03-49abf1e9fd9d" returned: 0 in 0.482s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:43:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [req-9e5d6fad-455b-4d5a-bb2d-4ae910c080f0 req-e533a909-0eaa-4c2c-a9da-a171658c09c0 tempest-TestMinimumBasicScenario-1673508297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.554s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:43:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-9e5d6fad-455b-4d5a-bb2d-4ae910c080f0 req-e533a909-0eaa-4c2c-a9da-a171658c09c0 tempest-TestMinimumBasicScenario-1673508297 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f', 'name': 'volume-5d9ded21-9670-4edd-8e03-49abf1e9fd9d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce8002ff-97e8-4151-8ddc-9e759d7345a9', 'enforce_multipath': True} {{(pid=84012) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 22 23:43:27 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-9e5d6fad-455b-4d5a-bb2d-4ae910c080f0 req-e533a909-0eaa-4c2c-a9da-a171658c09c0 tempest-TestMinimumBasicScenario-1673508297 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:43:27 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-9e5d6fad-455b-4d5a-bb2d-4ae910c080f0 req-e533a909-0eaa-4c2c-a9da-a171658c09c0 tempest-TestMinimumBasicScenario-1673508297 None] attachment_update completed successfully.
Sep 22 23:43:37 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:43:37 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:43:48 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:43:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:43:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:43:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:43:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:43:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:43:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:43:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.125s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:43:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:44:29 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:44:48 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:44:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:44:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:44:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:44:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:44:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:44:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:44:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.144s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:44:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:45:48 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:45:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:45:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:45:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:45:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:45:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:45:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:45:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.119s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:45:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:45:59 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-848ac3e1-27be-4577-b24c-59df5b681a5c req-b2109060-79dd-4979-8d02-769bbb159930 tempest-TestMinimumBasicScenario-1673508297 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:45:59 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [req-848ac3e1-27be-4577-b24c-59df5b681a5c req-b2109060-79dd-4979-8d02-769bbb159930 tempest-TestMinimumBasicScenario-1673508297 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:45:59 devstack cinder-volume[84012]: INFO cinder.volume.manager [req-848ac3e1-27be-4577-b24c-59df5b681a5c req-b2109060-79dd-4979-8d02-769bbb159930 tempest-TestMinimumBasicScenario-1673508297 None] Terminate volume connection completed successfully.
Sep 22 23:45:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [req-848ac3e1-27be-4577-b24c-59df5b681a5c req-b2109060-79dd-4979-8d02-769bbb159930 tempest-TestMinimumBasicScenario-1673508297 None] Deleting attachment ce8002ff-97e8-4151-8ddc-9e759d7345a9. {{(pid=84012) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 22 23:46:00 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c4b7e190-4c10-433c-ae8d-a3a2f1895c9a tempest-TestMinimumBasicScenario-1673508297 None] Acquiring lock "cinder-5d9ded21-9670-4edd-8e03-49abf1e9fd9d-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:46:00 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c4b7e190-4c10-433c-ae8d-a3a2f1895c9a tempest-TestMinimumBasicScenario-1673508297 None] Lock "cinder-5d9ded21-9670-4edd-8e03-49abf1e9fd9d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:46:00 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-c4b7e190-4c10-433c-ae8d-a3a2f1895c9a tempest-TestMinimumBasicScenario-1673508297 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:46:00 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c4b7e190-4c10-433c-ae8d-a3a2f1895c9a tempest-TestMinimumBasicScenario-1673508297 None] Acquiring lock "cinder-quobyte-5d9ded21-9670-4edd-8e03-49abf1e9fd9d" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:46:01 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c4b7e190-4c10-433c-ae8d-a3a2f1895c9a tempest-TestMinimumBasicScenario-1673508297 None] Lock "cinder-quobyte-5d9ded21-9670-4edd-8e03-49abf1e9fd9d" acquired by "delete_volume" :: waited 0.014s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:46:01 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8945557-3dc2-4ba2-a63b-ee010cf14ab7]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:46:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c4b7e190-4c10-433c-ae8d-a3a2f1895c9a tempest-TestMinimumBasicScenario-1673508297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d9ded21-9670-4edd-8e03-49abf1e9fd9d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c4b7e190-4c10-433c-ae8d-a3a2f1895c9a tempest-TestMinimumBasicScenario-1673508297 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d9ded21-9670-4edd-8e03-49abf1e9fd9d" returned: 0 in 0.446s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c4b7e190-4c10-433c-ae8d-a3a2f1895c9a tempest-TestMinimumBasicScenario-1673508297 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d9ded21-9670-4edd-8e03-49abf1e9fd9d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c4b7e190-4c10-433c-ae8d-a3a2f1895c9a tempest-TestMinimumBasicScenario-1673508297 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d9ded21-9670-4edd-8e03-49abf1e9fd9d" returned: 0 in 0.095s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:01 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c4b7e190-4c10-433c-ae8d-a3a2f1895c9a tempest-TestMinimumBasicScenario-1673508297 None] Lock "cinder-quobyte-5d9ded21-9670-4edd-8e03-49abf1e9fd9d" released by "delete_volume" :: held 0.676s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:46:01 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-c4b7e190-4c10-433c-ae8d-a3a2f1895c9a tempest-TestMinimumBasicScenario-1673508297 None] Created reservations ['d5cf1023-8001-4d37-935f-4c86af252126', '55e8f9de-de00-4904-9d92-c76b0bbc2689', 'e708efad-acd1-4ab1-aadc-4a81288ecd37', 'c2fe4952-321b-43f4-88b8-c387296f06ca'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:46:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c4b7e190-4c10-433c-ae8d-a3a2f1895c9a tempest-TestMinimumBasicScenario-1673508297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c4b7e190-4c10-433c-ae8d-a3a2f1895c9a tempest-TestMinimumBasicScenario-1673508297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:02 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c4b7e190-4c10-433c-ae8d-a3a2f1895c9a tempest-TestMinimumBasicScenario-1673508297 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:46:02 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c4b7e190-4c10-433c-ae8d-a3a2f1895c9a tempest-TestMinimumBasicScenario-1673508297 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:46:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c4b7e190-4c10-433c-ae8d-a3a2f1895c9a tempest-TestMinimumBasicScenario-1673508297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c4b7e190-4c10-433c-ae8d-a3a2f1895c9a tempest-TestMinimumBasicScenario-1673508297 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c4b7e190-4c10-433c-ae8d-a3a2f1895c9a tempest-TestMinimumBasicScenario-1673508297 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.095s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:02 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-c4b7e190-4c10-433c-ae8d-a3a2f1895c9a tempest-TestMinimumBasicScenario-1673508297 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:46:02 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-c4b7e190-4c10-433c-ae8d-a3a2f1895c9a tempest-TestMinimumBasicScenario-1673508297 None] Deleted volume successfully.
Sep 22 23:46:02 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-c4b7e190-4c10-433c-ae8d-a3a2f1895c9a tempest-TestMinimumBasicScenario-1673508297 None] Lock "cinder-5d9ded21-9670-4edd-8e03-49abf1e9fd9d-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:46:12 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:46:12 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:46:24 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Flow 'volume_create_manager' (66c3c537-8cab-42fc-9e59-09173e30a49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c663722a-3ef3-48d3-bab2-c06879285d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c663722a-3ef3-48d3-bab2-c06879285d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1656955217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=350f231c-0c53-443b-8f40-8c315eabbaab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3855a5588f43ee8dbb6820e03b3484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:24Z,use_quota=True,user_id='b4039bd27c4843278fbe17aa2fc13f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8cdd02-9a40-4880-9130-530f3fe1b1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8cdd02-9a40-4880-9130-530f3fe1b1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abdf5776-9a48-493f-90d4-702711aab7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abdf5776-9a48-493f-90d4-702711aab7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '350f231c-0c53-443b-8f40-8c315eabbaab', 'volume_name': 'volume-350f231c-0c53-443b-8f40-8c315eabbaab', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf65e18-3e80-4410-97da-75ec3cb08c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf65e18-3e80-4410-97da-75ec3cb08c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2835cc1-ca09-4f2f-bf68-8e9791b25393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:24 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Volume 350f231c-0c53-443b-8f40-8c315eabbaab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-350f231c-0c53-443b-8f40-8c315eabbaab', 'volume_size': 1}
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1656955217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=350f231c-0c53-443b-8f40-8c315eabbaab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3855a5588f43ee8dbb6820e03b3484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:24Z,use_quota=True,user_id='b4039bd27c4843278fbe17aa2fc13f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Creating volume 350f231c-0c53-443b-8f40-8c315eabbaab {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:46:24 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:46:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-350f231c-0c53-443b-8f40-8c315eabbaab 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:24 devstack quobyte-client[84065]: System call of process 100922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:24 devstack quobyte-client[84065]: System call of process 100922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:24 devstack quobyte-client[84065]: System call of process 100922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:24 devstack quobyte-client[84065]: System call of process 100922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:24 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=123, name=volume-350f231c-0c53-443b-8f40-8c315eabbaab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-350f231c-0c53-443b-8f40-8c315eabbaab 1073741824" returned: 0 in 0.536s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-350f231c-0c53-443b-8f40-8c315eabbaab {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:25 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Flow 'volume_create_manager' (659ec1b3-6e84-4619-a21c-da7151fc9713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bdfab8c-84ac-4f69-af82-1abd88e36f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-350f231c-0c53-443b-8f40-8c315eabbaab" returned: 0 in 0.567s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] <== create_volume: return (1150ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bdfab8c-84ac-4f69-af82-1abd88e36f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1780333758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d5cce8-7eed-46f5-94b3-ac8d72e02b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3855a5588f43ee8dbb6820e03b3484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:25Z,use_quota=True,user_id='b4039bd27c4843278fbe17aa2fc13f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa9c3f29-4210-4d9f-8c9d-0febe245cfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa9c3f29-4210-4d9f-8c9d-0febe245cfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8259c95-f08f-41a2-b231-3c167addd6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8259c95-f08f-41a2-b231-3c167addd6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82d5cce8-7eed-46f5-94b3-ac8d72e02b98', 'volume_name': 'volume-82d5cce8-7eed-46f5-94b3-ac8d72e02b98', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83346085-7b50-41a3-87bc-c93ef2dcd320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83346085-7b50-41a3-87bc-c93ef2dcd320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bda8d43-e178-484e-902b-0c33db469890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:25 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Volume 82d5cce8-7eed-46f5-94b3-ac8d72e02b98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82d5cce8-7eed-46f5-94b3-ac8d72e02b98', 'volume_size': 1}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1780333758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d5cce8-7eed-46f5-94b3-ac8d72e02b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3855a5588f43ee8dbb6820e03b3484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:25Z,use_quota=True,user_id='b4039bd27c4843278fbe17aa2fc13f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Creating volume 82d5cce8-7eed-46f5-94b3-ac8d72e02b98 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:46:25 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:46:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-82d5cce8-7eed-46f5-94b3-ac8d72e02b98 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:26 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:46:26 devstack quobyte-client[84065]: System call of process 100929 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:26 devstack quobyte-client[84065]: System call of process 100929 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:26 devstack quobyte-client[84065]: System call of process 100929 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:26 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=124, name=volume-82d5cce8-7eed-46f5-94b3-ac8d72e02b98, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Flow 'volume_create_manager' (73bbc434-6c06-4c3b-a228-b848f714c63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd9a712-a532-4dba-8a77-c66cd3ebd033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:26 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Flow 'volume_create_manager' (4e0835a4-4dd2-470d-ab43-2ba3a84da7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024d3163-7ee0-40ed-ad77-67acdfaaf01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd9a712-a532-4dba-8a77-c66cd3ebd033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1645384227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70de5d84-8612-4ece-9332-23e126a1d32f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3855a5588f43ee8dbb6820e03b3484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:26Z,use_quota=True,user_id='b4039bd27c4843278fbe17aa2fc13f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a3bd34-8982-4a67-8d92-c88d7260c716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a3bd34-8982-4a67-8d92-c88d7260c716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74df7331-32ee-4277-9834-732a449b0ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74df7331-32ee-4277-9834-732a449b0ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70de5d84-8612-4ece-9332-23e126a1d32f', 'volume_name': 'volume-70de5d84-8612-4ece-9332-23e126a1d32f', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d9a934-bd40-469f-805f-1621f4181173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d9a934-bd40-469f-805f-1621f4181173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ce1a63-2e8f-4161-9c26-5cf10e108ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:26 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Volume 70de5d84-8612-4ece-9332-23e126a1d32f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70de5d84-8612-4ece-9332-23e126a1d32f', 'volume_size': 1}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024d3163-7ee0-40ed-ad77-67acdfaaf01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-366348962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6439f12c-4fcc-4f28-b175-b24f8eddb3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3855a5588f43ee8dbb6820e03b3484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:25Z,use_quota=True,user_id='b4039bd27c4843278fbe17aa2fc13f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3b2cdc-4e6c-4369-8613-9fb8d367eb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3b2cdc-4e6c-4369-8613-9fb8d367eb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c058f78d-6d9a-4f63-95d6-61e931d5e782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c058f78d-6d9a-4f63-95d6-61e931d5e782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6439f12c-4fcc-4f28-b175-b24f8eddb3b0', 'volume_name': 'volume-6439f12c-4fcc-4f28-b175-b24f8eddb3b0', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d4a05f-530b-43bb-a949-91d5dfa8b4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d4a05f-530b-43bb-a949-91d5dfa8b4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fddb0eb6-e5cd-42a6-8f65-52dccb80421d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:26 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Volume 6439f12c-4fcc-4f28-b175-b24f8eddb3b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6439f12c-4fcc-4f28-b175-b24f8eddb3b0', 'volume_size': 1}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-82d5cce8-7eed-46f5-94b3-ac8d72e02b98 1073741824" returned: 0 in 0.702s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-82d5cce8-7eed-46f5-94b3-ac8d72e02b98 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:26 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Flow 'volume_create_manager' (5c3e255e-2ac9-4beb-83e7-d42765bb9548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:26 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646e1175-f9a5-4c65-8417-983349253d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646e1175-f9a5-4c65-8417-983349253d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1775491310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=155ce8c2-044d-449c-bd25-5a2cc46b6886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3855a5588f43ee8dbb6820e03b3484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:26Z,use_quota=True,user_id='b4039bd27c4843278fbe17aa2fc13f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03e376be-e38d-4e7f-b74a-e27c98d59085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03e376be-e38d-4e7f-b74a-e27c98d59085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a4acc1-6f21-4ee0-b8d0-98ea17ff21da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16a4acc1-6f21-4ee0-b8d0-98ea17ff21da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '155ce8c2-044d-449c-bd25-5a2cc46b6886', 'volume_name': 'volume-155ce8c2-044d-449c-bd25-5a2cc46b6886', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d4b262-e683-4d7e-bc0d-6f9dc31f2acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d4b262-e683-4d7e-bc0d-6f9dc31f2acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1857c8f1-6b34-43b4-92bd-f003fb5189c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:27 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Volume 155ce8c2-044d-449c-bd25-5a2cc46b6886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-155ce8c2-044d-449c-bd25-5a2cc46b6886', 'volume_size': 1}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2835cc1-ca09-4f2f-bf68-8e9791b25393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-350f231c-0c53-443b-8f40-8c315eabbaab', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a166ee00-962b-40fd-b7b8-31e147f4a896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-82d5cce8-7eed-46f5-94b3-ac8d72e02b98" returned: 0 in 0.467s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] <== create_volume: return (1194ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.527s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1645384227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70de5d84-8612-4ece-9332-23e126a1d32f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3855a5588f43ee8dbb6820e03b3484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:26Z,use_quota=True,user_id='b4039bd27c4843278fbe17aa2fc13f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Creating volume 70de5d84-8612-4ece-9332-23e126a1d32f {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:46:27 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-70de5d84-8612-4ece-9332-23e126a1d32f 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:27 devstack quobyte-client[84065]: System call of process 100934 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:27 devstack quobyte-client[84065]: System call of process 100934 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:27 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=125, name=volume-70de5d84-8612-4ece-9332-23e126a1d32f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:46:27 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Volume volume-350f231c-0c53-443b-8f40-8c315eabbaab (350f231c-0c53-443b-8f40-8c315eabbaab): created successfully
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a166ee00-962b-40fd-b7b8-31e147f4a896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Flow 'volume_create_manager' (66c3c537-8cab-42fc-9e59-09173e30a49b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bda8d43-e178-484e-902b-0c33db469890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82d5cce8-7eed-46f5-94b3-ac8d72e02b98', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769a6f7d-2698-4da4-a0cc-c2464f796ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-70de5d84-8612-4ece-9332-23e126a1d32f 1073741824" returned: 0 in 0.474s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-70de5d84-8612-4ece-9332-23e126a1d32f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:27 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-657f081c-7764-455d-b8fa-021e6f166762 tempest-CreateVolumesFromImageTest-1244490513 None] Created volume successfully.
Sep 22 23:46:27 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Volume volume-82d5cce8-7eed-46f5-94b3-ac8d72e02b98 (82d5cce8-7eed-46f5-94b3-ac8d72e02b98): created successfully
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769a6f7d-2698-4da4-a0cc-c2464f796ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Flow 'volume_create_manager' (659ec1b3-6e84-4619-a21c-da7151fc9713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-70de5d84-8612-4ece-9332-23e126a1d32f" returned: 0 in 0.314s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] <== create_volume: return (819ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.322s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-366348962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6439f12c-4fcc-4f28-b175-b24f8eddb3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3855a5588f43ee8dbb6820e03b3484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:25Z,use_quota=True,user_id='b4039bd27c4843278fbe17aa2fc13f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Creating volume 6439f12c-4fcc-4f28-b175-b24f8eddb3b0 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:46:27 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:46:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6439f12c-4fcc-4f28-b175-b24f8eddb3b0 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:28 devstack quobyte-client[84065]: System call of process 100938 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:28 devstack quobyte-client[84065]: System call of process 100938 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:28 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-a9a2279f-eacf-4be4-a469-0fe91a3c5416 tempest-CreateVolumesFromImageTest-1244490513 None] Created volume successfully.
Sep 22 23:46:28 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=126, name=volume-6439f12c-4fcc-4f28-b175-b24f8eddb3b0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:46:28 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ce1a63-2e8f-4161-9c26-5cf10e108ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70de5d84-8612-4ece-9332-23e126a1d32f', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:28 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ddc06a-6e22-4c1d-b9dd-4d6873559fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:28 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Volume volume-70de5d84-8612-4ece-9332-23e126a1d32f (70de5d84-8612-4ece-9332-23e126a1d32f): created successfully
Sep 22 23:46:28 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ddc06a-6e22-4c1d-b9dd-4d6873559fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:28 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Flow 'volume_create_manager' (73bbc434-6c06-4c3b-a228-b848f714c63f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6439f12c-4fcc-4f28-b175-b24f8eddb3b0 1073741824" returned: 0 in 0.483s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6439f12c-4fcc-4f28-b175-b24f8eddb3b0 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:28 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-a18cfa04-668e-4085-acf0-8bb730af3481 tempest-CreateVolumesFromImageTest-1244490513 None] Created volume successfully.
Sep 22 23:46:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6439f12c-4fcc-4f28-b175-b24f8eddb3b0" returned: 0 in 0.212s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:28 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] <== create_volume: return (720ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:46:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.663s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:28 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1775491310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=155ce8c2-044d-449c-bd25-5a2cc46b6886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3855a5588f43ee8dbb6820e03b3484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:26Z,use_quota=True,user_id='b4039bd27c4843278fbe17aa2fc13f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:46:28 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Creating volume 155ce8c2-044d-449c-bd25-5a2cc46b6886 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:46:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:28 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:46:28 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:46:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:28 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:46:28 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:46:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-155ce8c2-044d-449c-bd25-5a2cc46b6886 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:28 devstack quobyte-client[84065]: System call of process 100942 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:28 devstack quobyte-client[84065]: System call of process 100942 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:28 devstack quobyte-client[84065]: System call of process 100942 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:28 devstack quobyte-client[84065]: System call of process 100942 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:28 devstack quobyte-client[84065]: System call of process 100942 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:28 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=127, name=volume-155ce8c2-044d-449c-bd25-5a2cc46b6886, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:46:28 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fddb0eb6-e5cd-42a6-8f65-52dccb80421d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6439f12c-4fcc-4f28-b175-b24f8eddb3b0', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:28 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10d3669-0473-4bdf-a7ca-90cf103b8429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:29 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Volume volume-6439f12c-4fcc-4f28-b175-b24f8eddb3b0 (6439f12c-4fcc-4f28-b175-b24f8eddb3b0): created successfully
Sep 22 23:46:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10d3669-0473-4bdf-a7ca-90cf103b8429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Flow 'volume_create_manager' (4e0835a4-4dd2-470d-ab43-2ba3a84da7b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:29 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-5039cc63-b03f-4b5c-b7ed-b6d2bfec33e5 tempest-CreateVolumesFromImageTest-1244490513 None] Created volume successfully.
Sep 22 23:46:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-155ce8c2-044d-449c-bd25-5a2cc46b6886 1073741824" returned: 0 in 0.427s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-155ce8c2-044d-449c-bd25-5a2cc46b6886 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-155ce8c2-044d-449c-bd25-5a2cc46b6886" returned: 0 in 0.137s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] <== create_volume: return (609ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:46:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.632s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1857c8f1-6b34-43b4-92bd-f003fb5189c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-155ce8c2-044d-449c-bd25-5a2cc46b6886', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e543bc87-a885-435f-abc3-0dfc89bdf054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:29 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Volume volume-155ce8c2-044d-449c-bd25-5a2cc46b6886 (155ce8c2-044d-449c-bd25-5a2cc46b6886): created successfully
Sep 22 23:46:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e543bc87-a885-435f-abc3-0dfc89bdf054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Flow 'volume_create_manager' (5c3e255e-2ac9-4beb-83e7-d42765bb9548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:29 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-ddb7449f-225b-4f48-a999-efa2d99fc982 tempest-CreateVolumesFromImageTest-1244490513 None] Created volume successfully.
Sep 22 23:46:29 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d7c492bd-38be-4a94-bb44-bdde06c4cc80 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "cinder-155ce8c2-044d-449c-bd25-5a2cc46b6886-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:46:29 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d7c492bd-38be-4a94-bb44-bdde06c4cc80 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "cinder-155ce8c2-044d-449c-bd25-5a2cc46b6886-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:46:29 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-d7c492bd-38be-4a94-bb44-bdde06c4cc80 tempest-CreateVolumesFromImageTest-1244490513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:46:29 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d7c492bd-38be-4a94-bb44-bdde06c4cc80 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "cinder-quobyte-155ce8c2-044d-449c-bd25-5a2cc46b6886" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:46:29 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d7c492bd-38be-4a94-bb44-bdde06c4cc80 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "cinder-quobyte-155ce8c2-044d-449c-bd25-5a2cc46b6886" acquired by "delete_volume" :: waited 0.013s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:46:30 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1592594-3cc7-4a46-bdc6-810463b7b586]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:46:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d7c492bd-38be-4a94-bb44-bdde06c4cc80 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-155ce8c2-044d-449c-bd25-5a2cc46b6886 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d7c492bd-38be-4a94-bb44-bdde06c4cc80 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-155ce8c2-044d-449c-bd25-5a2cc46b6886" returned: 0 in 0.413s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d7c492bd-38be-4a94-bb44-bdde06c4cc80 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-155ce8c2-044d-449c-bd25-5a2cc46b6886 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d7c492bd-38be-4a94-bb44-bdde06c4cc80 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-155ce8c2-044d-449c-bd25-5a2cc46b6886" returned: 0 in 0.098s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:30 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d7c492bd-38be-4a94-bb44-bdde06c4cc80 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "cinder-quobyte-155ce8c2-044d-449c-bd25-5a2cc46b6886" released by "delete_volume" :: held 0.643s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:46:30 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-d7c492bd-38be-4a94-bb44-bdde06c4cc80 tempest-CreateVolumesFromImageTest-1244490513 None] Created reservations ['2bb092f8-2ba9-4c41-bd69-547c366749dc', 'ee55c64b-5541-47b7-92d8-4e882395f9fb', 'd887df79-7444-4e3b-9673-7ee362e536de', '9ba1d40e-51ae-4107-b00d-afb0f8448b18'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:46:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d7c492bd-38be-4a94-bb44-bdde06c4cc80 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d7c492bd-38be-4a94-bb44-bdde06c4cc80 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:31 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d7c492bd-38be-4a94-bb44-bdde06c4cc80 tempest-CreateVolumesFromImageTest-1244490513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:46:31 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d7c492bd-38be-4a94-bb44-bdde06c4cc80 tempest-CreateVolumesFromImageTest-1244490513 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:46:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d7c492bd-38be-4a94-bb44-bdde06c4cc80 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d7c492bd-38be-4a94-bb44-bdde06c4cc80 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d7c492bd-38be-4a94-bb44-bdde06c4cc80 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.099s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:31 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-d7c492bd-38be-4a94-bb44-bdde06c4cc80 tempest-CreateVolumesFromImageTest-1244490513 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:46:31 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-d7c492bd-38be-4a94-bb44-bdde06c4cc80 tempest-CreateVolumesFromImageTest-1244490513 None] Deleted volume successfully.
Sep 22 23:46:31 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-d7c492bd-38be-4a94-bb44-bdde06c4cc80 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "cinder-155ce8c2-044d-449c-bd25-5a2cc46b6886-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:46:32 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8bbcafc3-42dc-45f6-9b80-45cf7a703878 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "cinder-70de5d84-8612-4ece-9332-23e126a1d32f-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:46:32 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8bbcafc3-42dc-45f6-9b80-45cf7a703878 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "cinder-70de5d84-8612-4ece-9332-23e126a1d32f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:46:32 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-8bbcafc3-42dc-45f6-9b80-45cf7a703878 tempest-CreateVolumesFromImageTest-1244490513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:46:32 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8bbcafc3-42dc-45f6-9b80-45cf7a703878 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "cinder-quobyte-70de5d84-8612-4ece-9332-23e126a1d32f" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:46:32 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8bbcafc3-42dc-45f6-9b80-45cf7a703878 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "cinder-quobyte-70de5d84-8612-4ece-9332-23e126a1d32f" acquired by "delete_volume" :: waited 0.019s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:46:32 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0175be2-482d-436f-a3f3-c8977f33b416]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:46:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8bbcafc3-42dc-45f6-9b80-45cf7a703878 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-70de5d84-8612-4ece-9332-23e126a1d32f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8bbcafc3-42dc-45f6-9b80-45cf7a703878 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-70de5d84-8612-4ece-9332-23e126a1d32f" returned: 0 in 0.421s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8bbcafc3-42dc-45f6-9b80-45cf7a703878 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-70de5d84-8612-4ece-9332-23e126a1d32f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8bbcafc3-42dc-45f6-9b80-45cf7a703878 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-70de5d84-8612-4ece-9332-23e126a1d32f" returned: 0 in 0.090s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:32 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8bbcafc3-42dc-45f6-9b80-45cf7a703878 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "cinder-quobyte-70de5d84-8612-4ece-9332-23e126a1d32f" released by "delete_volume" :: held 0.666s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:46:33 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-8bbcafc3-42dc-45f6-9b80-45cf7a703878 tempest-CreateVolumesFromImageTest-1244490513 None] Created reservations ['48209ab7-c18c-497b-9efb-74ffd38e5b93', '01509b26-dc0e-482d-8586-2885f75c7844', 'f88b6050-89ae-4e7c-b375-8aa8263c65a6', '8ddb10ef-4541-474a-9f03-bebd044bb639'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:46:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8bbcafc3-42dc-45f6-9b80-45cf7a703878 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8bbcafc3-42dc-45f6-9b80-45cf7a703878 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-8bbcafc3-42dc-45f6-9b80-45cf7a703878 tempest-CreateVolumesFromImageTest-1244490513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:46:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-8bbcafc3-42dc-45f6-9b80-45cf7a703878 tempest-CreateVolumesFromImageTest-1244490513 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:46:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8bbcafc3-42dc-45f6-9b80-45cf7a703878 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8bbcafc3-42dc-45f6-9b80-45cf7a703878 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8bbcafc3-42dc-45f6-9b80-45cf7a703878 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.105s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:33 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-8bbcafc3-42dc-45f6-9b80-45cf7a703878 tempest-CreateVolumesFromImageTest-1244490513 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:46:33 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-8bbcafc3-42dc-45f6-9b80-45cf7a703878 tempest-CreateVolumesFromImageTest-1244490513 None] Deleted volume successfully.
Sep 22 23:46:33 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8bbcafc3-42dc-45f6-9b80-45cf7a703878 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "cinder-70de5d84-8612-4ece-9332-23e126a1d32f-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:46:34 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5f74d580-49bd-435c-9422-c7fd42f986d6 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "cinder-6439f12c-4fcc-4f28-b175-b24f8eddb3b0-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:46:34 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5f74d580-49bd-435c-9422-c7fd42f986d6 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "cinder-6439f12c-4fcc-4f28-b175-b24f8eddb3b0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:46:34 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-5f74d580-49bd-435c-9422-c7fd42f986d6 tempest-CreateVolumesFromImageTest-1244490513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:46:34 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5f74d580-49bd-435c-9422-c7fd42f986d6 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "cinder-quobyte-6439f12c-4fcc-4f28-b175-b24f8eddb3b0" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:46:34 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5f74d580-49bd-435c-9422-c7fd42f986d6 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "cinder-quobyte-6439f12c-4fcc-4f28-b175-b24f8eddb3b0" acquired by "delete_volume" :: waited 0.018s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:46:34 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[89939e3f-1dbd-4761-97fa-25bc7e2b19c8]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:46:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5f74d580-49bd-435c-9422-c7fd42f986d6 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6439f12c-4fcc-4f28-b175-b24f8eddb3b0 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5f74d580-49bd-435c-9422-c7fd42f986d6 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6439f12c-4fcc-4f28-b175-b24f8eddb3b0" returned: 0 in 0.403s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5f74d580-49bd-435c-9422-c7fd42f986d6 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6439f12c-4fcc-4f28-b175-b24f8eddb3b0 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5f74d580-49bd-435c-9422-c7fd42f986d6 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6439f12c-4fcc-4f28-b175-b24f8eddb3b0" returned: 0 in 0.108s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:35 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5f74d580-49bd-435c-9422-c7fd42f986d6 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "cinder-quobyte-6439f12c-4fcc-4f28-b175-b24f8eddb3b0" released by "delete_volume" :: held 0.649s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:46:35 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-5f74d580-49bd-435c-9422-c7fd42f986d6 tempest-CreateVolumesFromImageTest-1244490513 None] Created reservations ['dc69d18e-5c9d-4097-a460-0670c1bd9efe', '4bf083a6-ea19-40c6-8f28-a40bc2974a7a', '47bb2b74-378b-41f8-8715-16f3635778ad', '7081373c-4c35-40bf-9e2a-487c02c1456d'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:46:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5f74d580-49bd-435c-9422-c7fd42f986d6 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5f74d580-49bd-435c-9422-c7fd42f986d6 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5f74d580-49bd-435c-9422-c7fd42f986d6 tempest-CreateVolumesFromImageTest-1244490513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:46:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5f74d580-49bd-435c-9422-c7fd42f986d6 tempest-CreateVolumesFromImageTest-1244490513 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:46:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5f74d580-49bd-435c-9422-c7fd42f986d6 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5f74d580-49bd-435c-9422-c7fd42f986d6 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5f74d580-49bd-435c-9422-c7fd42f986d6 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.101s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:35 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-5f74d580-49bd-435c-9422-c7fd42f986d6 tempest-CreateVolumesFromImageTest-1244490513 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:46:35 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-5f74d580-49bd-435c-9422-c7fd42f986d6 tempest-CreateVolumesFromImageTest-1244490513 None] Deleted volume successfully.
Sep 22 23:46:35 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5f74d580-49bd-435c-9422-c7fd42f986d6 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "cinder-6439f12c-4fcc-4f28-b175-b24f8eddb3b0-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:46:36 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-efc286b0-90c9-414d-b90a-fc3b8cf1858d tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "cinder-82d5cce8-7eed-46f5-94b3-ac8d72e02b98-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:46:36 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-efc286b0-90c9-414d-b90a-fc3b8cf1858d tempest-CreateVolumesFromImageTest-1244490513 None] Lock "cinder-82d5cce8-7eed-46f5-94b3-ac8d72e02b98-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:46:36 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-efc286b0-90c9-414d-b90a-fc3b8cf1858d tempest-CreateVolumesFromImageTest-1244490513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:46:36 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-efc286b0-90c9-414d-b90a-fc3b8cf1858d tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "cinder-quobyte-82d5cce8-7eed-46f5-94b3-ac8d72e02b98" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:46:36 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-efc286b0-90c9-414d-b90a-fc3b8cf1858d tempest-CreateVolumesFromImageTest-1244490513 None] Lock "cinder-quobyte-82d5cce8-7eed-46f5-94b3-ac8d72e02b98" acquired by "delete_volume" :: waited 0.021s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:46:36 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3000d641-5126-41d3-b2bf-12649f3668b9]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:46:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-efc286b0-90c9-414d-b90a-fc3b8cf1858d tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-82d5cce8-7eed-46f5-94b3-ac8d72e02b98 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-efc286b0-90c9-414d-b90a-fc3b8cf1858d tempest-CreateVolumesFromImageTest-1244490513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-82d5cce8-7eed-46f5-94b3-ac8d72e02b98" returned: 0 in 0.382s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-efc286b0-90c9-414d-b90a-fc3b8cf1858d tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-82d5cce8-7eed-46f5-94b3-ac8d72e02b98 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-efc286b0-90c9-414d-b90a-fc3b8cf1858d tempest-CreateVolumesFromImageTest-1244490513 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-82d5cce8-7eed-46f5-94b3-ac8d72e02b98" returned: 0 in 0.103s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-efc286b0-90c9-414d-b90a-fc3b8cf1858d tempest-CreateVolumesFromImageTest-1244490513 None] Lock "cinder-quobyte-82d5cce8-7eed-46f5-94b3-ac8d72e02b98" released by "delete_volume" :: held 0.627s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:46:37 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-efc286b0-90c9-414d-b90a-fc3b8cf1858d tempest-CreateVolumesFromImageTest-1244490513 None] Created reservations ['be659d18-2403-4ea5-a09a-6f89b5e4fd30', '5fb96e43-a625-4187-88b4-6527fee3fa7e', '5240dc61-9048-4c01-a92d-327173e875aa', '84e13a47-5c6e-4e5e-a920-a0c89febc10e'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:46:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-efc286b0-90c9-414d-b90a-fc3b8cf1858d tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-efc286b0-90c9-414d-b90a-fc3b8cf1858d tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-efc286b0-90c9-414d-b90a-fc3b8cf1858d tempest-CreateVolumesFromImageTest-1244490513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:46:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-efc286b0-90c9-414d-b90a-fc3b8cf1858d tempest-CreateVolumesFromImageTest-1244490513 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:46:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-efc286b0-90c9-414d-b90a-fc3b8cf1858d tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-efc286b0-90c9-414d-b90a-fc3b8cf1858d tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-efc286b0-90c9-414d-b90a-fc3b8cf1858d tempest-CreateVolumesFromImageTest-1244490513 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.101s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:37 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-efc286b0-90c9-414d-b90a-fc3b8cf1858d tempest-CreateVolumesFromImageTest-1244490513 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:46:38 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-efc286b0-90c9-414d-b90a-fc3b8cf1858d tempest-CreateVolumesFromImageTest-1244490513 None] Deleted volume successfully.
Sep 22 23:46:38 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-efc286b0-90c9-414d-b90a-fc3b8cf1858d tempest-CreateVolumesFromImageTest-1244490513 None] Lock "cinder-82d5cce8-7eed-46f5-94b3-ac8d72e02b98-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:46:38 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1caad768-166a-4d87-b2c7-c149b3782ea7 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "cinder-350f231c-0c53-443b-8f40-8c315eabbaab-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:46:38 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1caad768-166a-4d87-b2c7-c149b3782ea7 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "cinder-350f231c-0c53-443b-8f40-8c315eabbaab-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:46:39 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-1caad768-166a-4d87-b2c7-c149b3782ea7 tempest-CreateVolumesFromImageTest-1244490513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:46:39 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1caad768-166a-4d87-b2c7-c149b3782ea7 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "cinder-quobyte-350f231c-0c53-443b-8f40-8c315eabbaab" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:46:39 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1caad768-166a-4d87-b2c7-c149b3782ea7 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "cinder-quobyte-350f231c-0c53-443b-8f40-8c315eabbaab" acquired by "delete_volume" :: waited 0.011s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:46:39 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3f8f94-45b0-49cd-aec4-e77fe13368de]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:46:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1caad768-166a-4d87-b2c7-c149b3782ea7 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-350f231c-0c53-443b-8f40-8c315eabbaab {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1caad768-166a-4d87-b2c7-c149b3782ea7 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-350f231c-0c53-443b-8f40-8c315eabbaab" returned: 0 in 0.396s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1caad768-166a-4d87-b2c7-c149b3782ea7 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-350f231c-0c53-443b-8f40-8c315eabbaab {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1caad768-166a-4d87-b2c7-c149b3782ea7 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-350f231c-0c53-443b-8f40-8c315eabbaab" returned: 0 in 0.103s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:39 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1caad768-166a-4d87-b2c7-c149b3782ea7 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "cinder-quobyte-350f231c-0c53-443b-8f40-8c315eabbaab" released by "delete_volume" :: held 0.632s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:46:39 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-1caad768-166a-4d87-b2c7-c149b3782ea7 tempest-CreateVolumesFromImageTest-1244490513 None] Created reservations ['dbccd0d6-1401-42d8-915e-0a665e5cb80f', '112cdfbb-fd1b-4be2-a485-1f42c2bcb35a', 'b9454155-ce09-40d7-8cd0-30d2df3665e4', 'a84690b1-c21f-487c-9dd5-6ea9dffb45cb'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:46:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1caad768-166a-4d87-b2c7-c149b3782ea7 tempest-CreateVolumesFromImageTest-1244490513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1caad768-166a-4d87-b2c7-c149b3782ea7 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1caad768-166a-4d87-b2c7-c149b3782ea7 tempest-CreateVolumesFromImageTest-1244490513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:46:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1caad768-166a-4d87-b2c7-c149b3782ea7 tempest-CreateVolumesFromImageTest-1244490513 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:46:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1caad768-166a-4d87-b2c7-c149b3782ea7 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1caad768-166a-4d87-b2c7-c149b3782ea7 tempest-CreateVolumesFromImageTest-1244490513 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1caad768-166a-4d87-b2c7-c149b3782ea7 tempest-CreateVolumesFromImageTest-1244490513 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.118s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:40 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-1caad768-166a-4d87-b2c7-c149b3782ea7 tempest-CreateVolumesFromImageTest-1244490513 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:46:40 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-1caad768-166a-4d87-b2c7-c149b3782ea7 tempest-CreateVolumesFromImageTest-1244490513 None] Deleted volume successfully.
Sep 22 23:46:40 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1caad768-166a-4d87-b2c7-c149b3782ea7 tempest-CreateVolumesFromImageTest-1244490513 None] Lock "cinder-350f231c-0c53-443b-8f40-8c315eabbaab-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:46:46 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Flow 'volume_create_manager' (4c3b70fc-d0b4-40f5-87f4-8b7f6390706c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c8ae42-6eb8-4826-b01d-4d9453d89b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c8ae42-6eb8-4826-b01d-4d9453d89b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1476019453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75ef3d9-980a-46eb-85df-b5d64c7e7130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc456e2b2664089b2aed3898d423a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:47Z,use_quota=True,user_id='c0909d6258e84922ac04b6d69909fabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbfd864d-63ad-481d-bb97-60f6dd885f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbfd864d-63ad-481d-bb97-60f6dd885f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae0a7ca-6887-416e-a3c1-ebbe7d0937bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae0a7ca-6887-416e-a3c1-ebbe7d0937bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b75ef3d9-980a-46eb-85df-b5d64c7e7130', 'volume_name': 'volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8779f9-bad9-4f09-addf-6ded8b8c4517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8779f9-bad9-4f09-addf-6ded8b8c4517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e43412-70b9-4f6a-9862-df87be48d3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:46 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume b75ef3d9-980a-46eb-85df-b5d64c7e7130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130', 'volume_size': 1}
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1476019453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75ef3d9-980a-46eb-85df-b5d64c7e7130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc456e2b2664089b2aed3898d423a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:47Z,use_quota=True,user_id='c0909d6258e84922ac04b6d69909fabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Creating volume b75ef3d9-980a-46eb-85df-b5d64c7e7130 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:46:46 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:46:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:47 devstack quobyte-client[84065]: System call of process 100975 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:47 devstack quobyte-client[84065]: System call of process 100975 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:47 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=128, name=volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:46:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130 1073741824" returned: 0 in 0.335s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130" returned: 0 in 0.080s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:47 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] <== create_volume: return (478ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:46:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.490s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e43412-70b9-4f6a-9862-df87be48d3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1714b4c8-7d02-48fc-b1b8-ac4268ec3a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:47 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130 (b75ef3d9-980a-46eb-85df-b5d64c7e7130): created successfully
Sep 22 23:46:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1714b4c8-7d02-48fc-b1b8-ac4268ec3a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:47 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Flow 'volume_create_manager' (4c3b70fc-d0b4-40f5-87f4-8b7f6390706c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:47 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-11b1df36-195e-45b7-b328-e4936a7e18de tempest-CreateVolumesFromSnapshotTest-699277118 None] Created volume successfully.
Sep 22 23:46:48 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:46:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:46:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:46:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.139s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:46:49 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:46:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] Creating offline snapshot 01f9d879-76e9-4250-b33b-79c123d53ff3 of volume b75ef3d9-980a-46eb-85df-b5d64c7e7130 {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:46:49 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7129877b-bcbd-4ced-89e7-d37cf2f213fc]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:46:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:49 devstack quobyte-client[84065]: System call of process 100982 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130" returned: 0 in 0.413s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.01f9d879-76e9-4250-b33b-79c123d53ff3 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:50 devstack quobyte-client[84065]: System call of process 100985 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:50 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=129, name=volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.01f9d879-76e9-4250-b33b-79c123d53ff3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:46:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.01f9d879-76e9-4250-b33b-79c123d53ff3 1G" returned: 0 in 0.254s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.01f9d879-76e9-4250-b33b-79c123d53ff3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:50 devstack quobyte-client[84065]: System call of process 100988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:50 devstack quobyte-client[84065]: System call of process 100988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "qemu-img rebase -u -b volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.01f9d879-76e9-4250-b33b-79c123d53ff3" returned: 0 in 0.151s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:50 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.01f9d879-76e9-4250-b33b-79c123d53ff3 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:46:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.01f9d879-76e9-4250-b33b-79c123d53ff3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.01f9d879-76e9-4250-b33b-79c123d53ff3" returned: 0 in 0.096s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:50 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130 -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:46:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.01f9d879-76e9-4250-b33b-79c123d53ff3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.01f9d879-76e9-4250-b33b-79c123d53ff3" returned: 0 in 0.091s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.info" returned: 0 in 0.093s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:50 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.info is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:46:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.info" returned: 0 in 0.083s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.554s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:51 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-44e755aa-da95-43ba-add9-8d193eb288a6 tempest-CreateVolumesFromSnapshotTest-699277118 None] Create snapshot completed successfully
Sep 22 23:46:52 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Flow 'volume_create_manager' (eb4698c8-1393-4232-8986-f05be51fe2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ddceff-b92e-4168-919c-1527d4c43d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ddceff-b92e-4168-919c-1527d4c43d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1189150544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c54fe8-ead4-4c9a-94a8-c9498152339c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc456e2b2664089b2aed3898d423a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:53Z,use_quota=True,user_id='c0909d6258e84922ac04b6d69909fabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455b0fed-cced-4057-9413-4feeab5ae9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455b0fed-cced-4057-9413-4feeab5ae9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a18606f-378b-44a3-8239-cb06864777ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a18606f-378b-44a3-8239-cb06864777ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3c54fe8-ead4-4c9a-94a8-c9498152339c', 'volume_name': 'volume-e3c54fe8-ead4-4c9a-94a8-c9498152339c', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75199224-66f0-4b48-92f8-434feb226630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75199224-66f0-4b48-92f8-434feb226630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1056bc0c-b54a-46e5-a734-b80b131e1087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:52 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume e3c54fe8-ead4-4c9a-94a8-c9498152339c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3c54fe8-ead4-4c9a-94a8-c9498152339c', 'volume_size': 1}
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1189150544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c54fe8-ead4-4c9a-94a8-c9498152339c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc456e2b2664089b2aed3898d423a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:53Z,use_quota=True,user_id='c0909d6258e84922ac04b6d69909fabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Creating volume e3c54fe8-ead4-4c9a-94a8-c9498152339c {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:46:52 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:46:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3c54fe8-ead4-4c9a-94a8-c9498152339c 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:53 devstack quobyte-client[84065]: System call of process 100995 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:53 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=131, name=volume-e3c54fe8-ead4-4c9a-94a8-c9498152339c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:46:53 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:46:53 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:46:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Flow 'volume_create_manager' (967d4220-f0ab-4eb2-b6f9-1a720b7cb8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:53 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd32515-360f-4d64-ab85-b595f0abb136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3c54fe8-ead4-4c9a-94a8-c9498152339c 1073741824" returned: 0 in 0.687s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3c54fe8-ead4-4c9a-94a8-c9498152339c {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd32515-360f-4d64-ab85-b595f0abb136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-216843650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6092cc1e-4eed-4ff1-bb46-fdf7fda35373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc456e2b2664089b2aed3898d423a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:53Z,use_quota=True,user_id='c0909d6258e84922ac04b6d69909fabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff42b50c-828d-4ffe-94d6-e2964730f032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff42b50c-828d-4ffe-94d6-e2964730f032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314058be-0336-45d3-b821-e2373e5c04f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314058be-0336-45d3-b821-e2373e5c04f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6092cc1e-4eed-4ff1-bb46-fdf7fda35373', 'volume_name': 'volume-6092cc1e-4eed-4ff1-bb46-fdf7fda35373', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f51175-8403-46a9-a1fc-80dd17acbd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f51175-8403-46a9-a1fc-80dd17acbd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e81685-21b7-48d4-8090-006784a827a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:54 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume 6092cc1e-4eed-4ff1-bb46-fdf7fda35373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6092cc1e-4eed-4ff1-bb46-fdf7fda35373', 'volume_size': 1}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:54 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Flow 'volume_create_manager' (b8ca34d5-04e7-4350-82bd-f34e949b1631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3594a3-1ac0-41f0-b626-a12dc55840b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3c54fe8-ead4-4c9a-94a8-c9498152339c" returned: 0 in 0.633s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] <== create_volume: return (1348ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.165s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-216843650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6092cc1e-4eed-4ff1-bb46-fdf7fda35373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc456e2b2664089b2aed3898d423a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:53Z,use_quota=True,user_id='c0909d6258e84922ac04b6d69909fabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Creating volume 6092cc1e-4eed-4ff1-bb46-fdf7fda35373 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:46:54 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6092cc1e-4eed-4ff1-bb46-fdf7fda35373 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:54 devstack quobyte-client[84065]: System call of process 100999 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:54 devstack quobyte-client[84065]: System call of process 100999 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:54 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:46:54 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=132, name=volume-6092cc1e-4eed-4ff1-bb46-fdf7fda35373, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Flow 'volume_create_manager' (cd3e1848-1af5-4602-8b44-fe5e4a3330b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908daac3-57f1-4ed3-9505-729365fa73c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3594a3-1ac0-41f0-b626-a12dc55840b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1534232707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03e021b-0beb-4419-a42e-29d97e211958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc456e2b2664089b2aed3898d423a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:54Z,use_quota=True,user_id='c0909d6258e84922ac04b6d69909fabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467de608-7a0d-4a24-a1da-63066908cb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467de608-7a0d-4a24-a1da-63066908cb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc69bf1e-d710-4dff-9773-3a778cf49b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc69bf1e-d710-4dff-9773-3a778cf49b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e03e021b-0beb-4419-a42e-29d97e211958', 'volume_name': 'volume-e03e021b-0beb-4419-a42e-29d97e211958', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ffa839-450d-4c96-a4f5-154f59932183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ffa839-450d-4c96-a4f5-154f59932183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1187413c-ba08-4b7f-b80a-62776981e94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:54 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume e03e021b-0beb-4419-a42e-29d97e211958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e03e021b-0beb-4419-a42e-29d97e211958', 'volume_size': 1}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908daac3-57f1-4ed3-9505-729365fa73c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-571602747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d629c3e-46af-443a-a780-f66e37def16a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc456e2b2664089b2aed3898d423a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:54Z,use_quota=True,user_id='c0909d6258e84922ac04b6d69909fabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d44767-307c-4c9b-8634-9bffa3e2df35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d44767-307c-4c9b-8634-9bffa3e2df35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2514e3ee-1de3-485d-8a40-c6b0d74d6528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2514e3ee-1de3-485d-8a40-c6b0d74d6528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d629c3e-46af-443a-a780-f66e37def16a', 'volume_name': 'volume-5d629c3e-46af-443a-a780-f66e37def16a', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c4e915-931e-424d-a755-f7dfd62c1f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c4e915-931e-424d-a755-f7dfd62c1f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ef7c347-ef69-4d72-a614-c18619b398c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:54 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume 5d629c3e-46af-443a-a780-f66e37def16a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d629c3e-46af-443a-a780-f66e37def16a', 'volume_size': 1}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1056bc0c-b54a-46e5-a734-b80b131e1087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3c54fe8-ead4-4c9a-94a8-c9498152339c', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c1bea6-dde0-4d7f-9598-e9cac737d0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:55 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Flow 'volume_create_manager' (781377ec-a5a3-476b-b2fd-ee7f90fc5d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9cae8b-f5dd-4a35-8a40-b47f8aed8d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:55 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume volume-e3c54fe8-ead4-4c9a-94a8-c9498152339c (e3c54fe8-ead4-4c9a-94a8-c9498152339c): created successfully
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c1bea6-dde0-4d7f-9598-e9cac737d0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Flow 'volume_create_manager' (eb4698c8-1393-4232-8986-f05be51fe2a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6092cc1e-4eed-4ff1-bb46-fdf7fda35373 1073741824" returned: 0 in 0.693s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6092cc1e-4eed-4ff1-bb46-fdf7fda35373 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9cae8b-f5dd-4a35-8a40-b47f8aed8d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2039320554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f643dd9-34dd-40b3-9834-e1685433d638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc456e2b2664089b2aed3898d423a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:54Z,use_quota=True,user_id='c0909d6258e84922ac04b6d69909fabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35432b0-47e6-490f-a0f1-6917b3dedc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35432b0-47e6-490f-a0f1-6917b3dedc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6cee859-3654-4796-8ccc-bb6fea4991c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6cee859-3654-4796-8ccc-bb6fea4991c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f643dd9-34dd-40b3-9834-e1685433d638', 'volume_name': 'volume-2f643dd9-34dd-40b3-9834-e1685433d638', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681bc1cc-2ef6-4bf3-9179-6023597a0d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681bc1cc-2ef6-4bf3-9179-6023597a0d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f603e88-4d65-4e85-9bba-a8d4a719f49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:55 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume 2f643dd9-34dd-40b3-9834-e1685433d638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f643dd9-34dd-40b3-9834-e1685433d638', 'volume_size': 1}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:55 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-f529a902-84bf-4e80-ad39-fddd84bab2c9 tempest-CreateVolumesFromSnapshotTest-699277118 None] Created volume successfully.
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6092cc1e-4eed-4ff1-bb46-fdf7fda35373" returned: 0 in 0.371s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] <== create_volume: return (1085ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.573s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1534232707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03e021b-0beb-4419-a42e-29d97e211958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc456e2b2664089b2aed3898d423a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:54Z,use_quota=True,user_id='c0909d6258e84922ac04b6d69909fabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Creating volume e03e021b-0beb-4419-a42e-29d97e211958 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:46:55 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e03e021b-0beb-4419-a42e-29d97e211958 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:55 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=133, name=volume-e03e021b-0beb-4419-a42e-29d97e211958, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e81685-21b7-48d4-8090-006784a827a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6092cc1e-4eed-4ff1-bb46-fdf7fda35373', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384cf0c5-6f80-4fe7-a7bc-11b29e3e6a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:55 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume volume-6092cc1e-4eed-4ff1-bb46-fdf7fda35373 (6092cc1e-4eed-4ff1-bb46-fdf7fda35373): created successfully
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384cf0c5-6f80-4fe7-a7bc-11b29e3e6a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Flow 'volume_create_manager' (967d4220-f0ab-4eb2-b6f9-1a720b7cb8d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e03e021b-0beb-4419-a42e-29d97e211958 1073741824" returned: 0 in 0.418s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e03e021b-0beb-4419-a42e-29d97e211958 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:56 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-052a9f70-8313-484c-9d5f-aaef1338da0a tempest-CreateVolumesFromSnapshotTest-699277118 None] Created volume successfully.
Sep 22 23:46:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e03e021b-0beb-4419-a42e-29d97e211958" returned: 0 in 0.217s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:56 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] <== create_volume: return (657ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:46:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.173s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:56 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-571602747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d629c3e-46af-443a-a780-f66e37def16a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc456e2b2664089b2aed3898d423a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:54Z,use_quota=True,user_id='c0909d6258e84922ac04b6d69909fabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:46:56 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Creating volume 5d629c3e-46af-443a-a780-f66e37def16a {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:46:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:56 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:46:56 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:46:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:56 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:46:56 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:46:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d629c3e-46af-443a-a780-f66e37def16a 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:56 devstack quobyte-client[84065]: System call of process 101007 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:56 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=134, name=volume-5d629c3e-46af-443a-a780-f66e37def16a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:46:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1187413c-ba08-4b7f-b80a-62776981e94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e03e021b-0beb-4419-a42e-29d97e211958', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a5e8ee-d7c9-48d6-acd5-b8fded0eccfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:56 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume volume-e03e021b-0beb-4419-a42e-29d97e211958 (e03e021b-0beb-4419-a42e-29d97e211958): created successfully
Sep 22 23:46:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a5e8ee-d7c9-48d6-acd5-b8fded0eccfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Flow 'volume_create_manager' (b8ca34d5-04e7-4350-82bd-f34e949b1631) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d629c3e-46af-443a-a780-f66e37def16a 1073741824" returned: 0 in 0.478s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d629c3e-46af-443a-a780-f66e37def16a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:56 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-923e8031-bbe8-4106-96bc-80800e63085c tempest-CreateVolumesFromSnapshotTest-699277118 None] Created volume successfully.
Sep 22 23:46:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d629c3e-46af-443a-a780-f66e37def16a" returned: 0 in 0.316s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] <== create_volume: return (830ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:46:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.687s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2039320554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f643dd9-34dd-40b3-9834-e1685433d638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfc456e2b2664089b2aed3898d423a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:46:54Z,use_quota=True,user_id='c0909d6258e84922ac04b6d69909fabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:46:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Creating volume 2f643dd9-34dd-40b3-9834-e1685433d638 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:46:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:46:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:46:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:46:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:46:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:46:57 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:46:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2f643dd9-34dd-40b3-9834-e1685433d638 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:57 devstack quobyte-client[84065]: System call of process 101042 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:57 devstack quobyte-client[84065]: System call of process 101042 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:57 devstack quobyte-client[84065]: System call of process 101042 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:57 devstack quobyte-client[84065]: System call of process 101042 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:46:57 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=135, name=volume-2f643dd9-34dd-40b3-9834-e1685433d638, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:46:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ef7c347-ef69-4d72-a614-c18619b398c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d629c3e-46af-443a-a780-f66e37def16a', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ba20b9-5321-4810-8a93-cfcffbb37429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:57 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume volume-5d629c3e-46af-443a-a780-f66e37def16a (5d629c3e-46af-443a-a780-f66e37def16a): created successfully
Sep 22 23:46:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ba20b9-5321-4810-8a93-cfcffbb37429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Flow 'volume_create_manager' (cd3e1848-1af5-4602-8b44-fe5e4a3330b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2f643dd9-34dd-40b3-9834-e1685433d638 1073741824" returned: 0 in 0.646s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2f643dd9-34dd-40b3-9834-e1685433d638 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:57 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-d0ab7142-be6d-408f-8dc6-d09e19b8766b tempest-CreateVolumesFromSnapshotTest-699277118 None] Created volume successfully.
Sep 22 23:46:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2f643dd9-34dd-40b3-9834-e1685433d638" returned: 0 in 0.252s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:58 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] <== create_volume: return (955ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:46:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:46:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f603e88-4d65-4e85-9bba-a8d4a719f49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f643dd9-34dd-40b3-9834-e1685433d638', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853705bf-87d2-44c2-8956-8080098ea974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:46:58 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume volume-2f643dd9-34dd-40b3-9834-e1685433d638 (2f643dd9-34dd-40b3-9834-e1685433d638): created successfully
Sep 22 23:46:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853705bf-87d2-44c2-8956-8080098ea974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:46:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Flow 'volume_create_manager' (781377ec-a5a3-476b-b2fd-ee7f90fc5d62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:46:58 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-5fa234e1-503f-401d-8293-f8d2bf864869 tempest-CreateVolumesFromSnapshotTest-699277118 None] Created volume successfully.
Sep 22 23:46:59 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9d5b241e-b7b0-42a1-8999-4324f011a818 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "cinder-2f643dd9-34dd-40b3-9834-e1685433d638-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:46:59 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9d5b241e-b7b0-42a1-8999-4324f011a818 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-2f643dd9-34dd-40b3-9834-e1685433d638-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:46:59 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-9d5b241e-b7b0-42a1-8999-4324f011a818 tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:46:59 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9d5b241e-b7b0-42a1-8999-4324f011a818 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "cinder-quobyte-2f643dd9-34dd-40b3-9834-e1685433d638" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:46:59 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9d5b241e-b7b0-42a1-8999-4324f011a818 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-quobyte-2f643dd9-34dd-40b3-9834-e1685433d638" acquired by "delete_volume" :: waited 0.013s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:46:59 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c080cc1b-f25d-43f5-9c8c-df6d6825bd73]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:46:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9d5b241e-b7b0-42a1-8999-4324f011a818 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2f643dd9-34dd-40b3-9834-e1685433d638 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:46:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9d5b241e-b7b0-42a1-8999-4324f011a818 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2f643dd9-34dd-40b3-9834-e1685433d638" returned: 0 in 0.391s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:46:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9d5b241e-b7b0-42a1-8999-4324f011a818 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2f643dd9-34dd-40b3-9834-e1685433d638 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9d5b241e-b7b0-42a1-8999-4324f011a818 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2f643dd9-34dd-40b3-9834-e1685433d638" returned: 0 in 0.105s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:00 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9d5b241e-b7b0-42a1-8999-4324f011a818 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-quobyte-2f643dd9-34dd-40b3-9834-e1685433d638" released by "delete_volume" :: held 0.634s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:00 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-9d5b241e-b7b0-42a1-8999-4324f011a818 tempest-CreateVolumesFromSnapshotTest-699277118 None] Created reservations ['e7e7c2a1-d1a8-489b-b3ba-74ddaa44317f', '1336fcb9-db1f-4301-9760-e42b202ad39b', '859a0b2a-258e-4e61-917c-16807e650b54', 'b5341140-0515-46e4-b22e-fc92d451b0aa'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:47:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9d5b241e-b7b0-42a1-8999-4324f011a818 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9d5b241e-b7b0-42a1-8999-4324f011a818 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-9d5b241e-b7b0-42a1-8999-4324f011a818 tempest-CreateVolumesFromSnapshotTest-699277118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:47:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-9d5b241e-b7b0-42a1-8999-4324f011a818 tempest-CreateVolumesFromSnapshotTest-699277118 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:47:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9d5b241e-b7b0-42a1-8999-4324f011a818 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9d5b241e-b7b0-42a1-8999-4324f011a818 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9d5b241e-b7b0-42a1-8999-4324f011a818 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.112s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:00 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-9d5b241e-b7b0-42a1-8999-4324f011a818 tempest-CreateVolumesFromSnapshotTest-699277118 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:47:00 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-9d5b241e-b7b0-42a1-8999-4324f011a818 tempest-CreateVolumesFromSnapshotTest-699277118 None] Deleted volume successfully.
Sep 22 23:47:00 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9d5b241e-b7b0-42a1-8999-4324f011a818 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-2f643dd9-34dd-40b3-9834-e1685433d638-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:01 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-59087b8c-397b-4e6b-9b11-759ceff946a5 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "cinder-5d629c3e-46af-443a-a780-f66e37def16a-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:01 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-59087b8c-397b-4e6b-9b11-759ceff946a5 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-5d629c3e-46af-443a-a780-f66e37def16a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:01 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-59087b8c-397b-4e6b-9b11-759ceff946a5 tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:47:01 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-59087b8c-397b-4e6b-9b11-759ceff946a5 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "cinder-quobyte-5d629c3e-46af-443a-a780-f66e37def16a" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:01 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-59087b8c-397b-4e6b-9b11-759ceff946a5 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-quobyte-5d629c3e-46af-443a-a780-f66e37def16a" acquired by "delete_volume" :: waited 0.012s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:01 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[7118744d-3211-43fc-a848-5cc5cdb73889]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:47:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-59087b8c-397b-4e6b-9b11-759ceff946a5 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d629c3e-46af-443a-a780-f66e37def16a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-59087b8c-397b-4e6b-9b11-759ceff946a5 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d629c3e-46af-443a-a780-f66e37def16a" returned: 0 in 0.372s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-59087b8c-397b-4e6b-9b11-759ceff946a5 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d629c3e-46af-443a-a780-f66e37def16a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-59087b8c-397b-4e6b-9b11-759ceff946a5 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5d629c3e-46af-443a-a780-f66e37def16a" returned: 0 in 0.102s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:02 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-59087b8c-397b-4e6b-9b11-759ceff946a5 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-quobyte-5d629c3e-46af-443a-a780-f66e37def16a" released by "delete_volume" :: held 0.615s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:02 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-59087b8c-397b-4e6b-9b11-759ceff946a5 tempest-CreateVolumesFromSnapshotTest-699277118 None] Created reservations ['6003465a-ba7a-4822-ac37-436870206320', 'f5e93e40-0a56-4abb-9996-3ee6c903ae84', 'd0e57ceb-0605-44fd-a4dc-57b33e08fe07', '2379116a-e3f8-4025-bbf5-1ccf1effabb6'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:47:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-59087b8c-397b-4e6b-9b11-759ceff946a5 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-59087b8c-397b-4e6b-9b11-759ceff946a5 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:02 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-59087b8c-397b-4e6b-9b11-759ceff946a5 tempest-CreateVolumesFromSnapshotTest-699277118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:47:02 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-59087b8c-397b-4e6b-9b11-759ceff946a5 tempest-CreateVolumesFromSnapshotTest-699277118 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:47:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-59087b8c-397b-4e6b-9b11-759ceff946a5 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-59087b8c-397b-4e6b-9b11-759ceff946a5 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-59087b8c-397b-4e6b-9b11-759ceff946a5 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.109s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:02 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-59087b8c-397b-4e6b-9b11-759ceff946a5 tempest-CreateVolumesFromSnapshotTest-699277118 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:47:02 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-59087b8c-397b-4e6b-9b11-759ceff946a5 tempest-CreateVolumesFromSnapshotTest-699277118 None] Deleted volume successfully.
Sep 22 23:47:03 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-59087b8c-397b-4e6b-9b11-759ceff946a5 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-5d629c3e-46af-443a-a780-f66e37def16a-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:03 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1c3b08fe-56d1-49e5-a60e-23020c2fb4d3 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "cinder-e03e021b-0beb-4419-a42e-29d97e211958-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:03 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1c3b08fe-56d1-49e5-a60e-23020c2fb4d3 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-e03e021b-0beb-4419-a42e-29d97e211958-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:03 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-1c3b08fe-56d1-49e5-a60e-23020c2fb4d3 tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:47:03 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1c3b08fe-56d1-49e5-a60e-23020c2fb4d3 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "cinder-quobyte-e03e021b-0beb-4419-a42e-29d97e211958" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:03 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1c3b08fe-56d1-49e5-a60e-23020c2fb4d3 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-quobyte-e03e021b-0beb-4419-a42e-29d97e211958" acquired by "delete_volume" :: waited 0.012s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:04 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed74ca40-0a72-4f62-b692-34a1c63147d8]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:47:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1c3b08fe-56d1-49e5-a60e-23020c2fb4d3 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e03e021b-0beb-4419-a42e-29d97e211958 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1c3b08fe-56d1-49e5-a60e-23020c2fb4d3 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e03e021b-0beb-4419-a42e-29d97e211958" returned: 0 in 0.403s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1c3b08fe-56d1-49e5-a60e-23020c2fb4d3 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e03e021b-0beb-4419-a42e-29d97e211958 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1c3b08fe-56d1-49e5-a60e-23020c2fb4d3 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e03e021b-0beb-4419-a42e-29d97e211958" returned: 0 in 0.086s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1c3b08fe-56d1-49e5-a60e-23020c2fb4d3 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-quobyte-e03e021b-0beb-4419-a42e-29d97e211958" released by "delete_volume" :: held 0.644s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:04 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-1c3b08fe-56d1-49e5-a60e-23020c2fb4d3 tempest-CreateVolumesFromSnapshotTest-699277118 None] Created reservations ['4f4d8d97-546d-48cd-83d6-d0bdee429fb7', '11b5df37-a334-438b-aaf3-eecaf3435435', 'd01c6aed-1c74-4beb-a01e-c980dce20dca', '396e31ad-976d-4561-bbc3-fb6150cf4f46'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:47:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1c3b08fe-56d1-49e5-a60e-23020c2fb4d3 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1c3b08fe-56d1-49e5-a60e-23020c2fb4d3 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1c3b08fe-56d1-49e5-a60e-23020c2fb4d3 tempest-CreateVolumesFromSnapshotTest-699277118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:47:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1c3b08fe-56d1-49e5-a60e-23020c2fb4d3 tempest-CreateVolumesFromSnapshotTest-699277118 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:47:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1c3b08fe-56d1-49e5-a60e-23020c2fb4d3 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1c3b08fe-56d1-49e5-a60e-23020c2fb4d3 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1c3b08fe-56d1-49e5-a60e-23020c2fb4d3 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.090s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:05 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-1c3b08fe-56d1-49e5-a60e-23020c2fb4d3 tempest-CreateVolumesFromSnapshotTest-699277118 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:47:05 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-1c3b08fe-56d1-49e5-a60e-23020c2fb4d3 tempest-CreateVolumesFromSnapshotTest-699277118 None] Deleted volume successfully.
Sep 22 23:47:05 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-1c3b08fe-56d1-49e5-a60e-23020c2fb4d3 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-e03e021b-0beb-4419-a42e-29d97e211958-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b0d25339-22cb-4251-87bc-2c1c6e7e9191 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "cinder-6092cc1e-4eed-4ff1-bb46-fdf7fda35373-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b0d25339-22cb-4251-87bc-2c1c6e7e9191 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-6092cc1e-4eed-4ff1-bb46-fdf7fda35373-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:06 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-b0d25339-22cb-4251-87bc-2c1c6e7e9191 tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:47:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b0d25339-22cb-4251-87bc-2c1c6e7e9191 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "cinder-quobyte-6092cc1e-4eed-4ff1-bb46-fdf7fda35373" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b0d25339-22cb-4251-87bc-2c1c6e7e9191 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-quobyte-6092cc1e-4eed-4ff1-bb46-fdf7fda35373" acquired by "delete_volume" :: waited 0.014s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:06 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcdb6ab-35d7-4945-8b57-eeff8a38d58a]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:47:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b0d25339-22cb-4251-87bc-2c1c6e7e9191 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6092cc1e-4eed-4ff1-bb46-fdf7fda35373 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b0d25339-22cb-4251-87bc-2c1c6e7e9191 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6092cc1e-4eed-4ff1-bb46-fdf7fda35373" returned: 0 in 0.404s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b0d25339-22cb-4251-87bc-2c1c6e7e9191 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6092cc1e-4eed-4ff1-bb46-fdf7fda35373 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b0d25339-22cb-4251-87bc-2c1c6e7e9191 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-6092cc1e-4eed-4ff1-bb46-fdf7fda35373" returned: 0 in 0.108s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:06 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b0d25339-22cb-4251-87bc-2c1c6e7e9191 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-quobyte-6092cc1e-4eed-4ff1-bb46-fdf7fda35373" released by "delete_volume" :: held 0.668s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:07 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-b0d25339-22cb-4251-87bc-2c1c6e7e9191 tempest-CreateVolumesFromSnapshotTest-699277118 None] Created reservations ['c5a7d8e9-bbe5-4923-a51f-94dc26b301b0', '4bad807a-f6ca-4d9d-b1ee-c3c8889897ed', 'd4d797b5-6d38-42e4-8ddc-8982b17e93a1', '2ad38f59-a385-4f24-8f56-176622f2dfeb'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:47:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b0d25339-22cb-4251-87bc-2c1c6e7e9191 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b0d25339-22cb-4251-87bc-2c1c6e7e9191 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:07 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b0d25339-22cb-4251-87bc-2c1c6e7e9191 tempest-CreateVolumesFromSnapshotTest-699277118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:47:07 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b0d25339-22cb-4251-87bc-2c1c6e7e9191 tempest-CreateVolumesFromSnapshotTest-699277118 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:47:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b0d25339-22cb-4251-87bc-2c1c6e7e9191 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b0d25339-22cb-4251-87bc-2c1c6e7e9191 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b0d25339-22cb-4251-87bc-2c1c6e7e9191 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.118s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:07 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-b0d25339-22cb-4251-87bc-2c1c6e7e9191 tempest-CreateVolumesFromSnapshotTest-699277118 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:47:07 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-b0d25339-22cb-4251-87bc-2c1c6e7e9191 tempest-CreateVolumesFromSnapshotTest-699277118 None] Deleted volume successfully.
Sep 22 23:47:07 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b0d25339-22cb-4251-87bc-2c1c6e7e9191 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-6092cc1e-4eed-4ff1-bb46-fdf7fda35373-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:08 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-f040b28d-deda-4c30-a6f3-5c0afc0a1718 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "cinder-e3c54fe8-ead4-4c9a-94a8-c9498152339c-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:08 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-f040b28d-deda-4c30-a6f3-5c0afc0a1718 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-e3c54fe8-ead4-4c9a-94a8-c9498152339c-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:08 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-f040b28d-deda-4c30-a6f3-5c0afc0a1718 tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:47:08 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-f040b28d-deda-4c30-a6f3-5c0afc0a1718 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "cinder-quobyte-e3c54fe8-ead4-4c9a-94a8-c9498152339c" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:08 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-f040b28d-deda-4c30-a6f3-5c0afc0a1718 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-quobyte-e3c54fe8-ead4-4c9a-94a8-c9498152339c" acquired by "delete_volume" :: waited 0.014s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:08 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[17843b46-0556-44f3-bec7-3fb2e146273c]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:47:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f040b28d-deda-4c30-a6f3-5c0afc0a1718 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3c54fe8-ead4-4c9a-94a8-c9498152339c {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:08 devstack quobyte-client[84065]: System call of process 101075 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:47:08 devstack quobyte-client[84065]: System call of process 101075 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:47:08 devstack quobyte-client[84065]: System call of process 101075 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:47:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f040b28d-deda-4c30-a6f3-5c0afc0a1718 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3c54fe8-ead4-4c9a-94a8-c9498152339c" returned: 0 in 0.409s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f040b28d-deda-4c30-a6f3-5c0afc0a1718 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3c54fe8-ead4-4c9a-94a8-c9498152339c {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f040b28d-deda-4c30-a6f3-5c0afc0a1718 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-e3c54fe8-ead4-4c9a-94a8-c9498152339c" returned: 0 in 0.112s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:09 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-f040b28d-deda-4c30-a6f3-5c0afc0a1718 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-quobyte-e3c54fe8-ead4-4c9a-94a8-c9498152339c" released by "delete_volume" :: held 0.666s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:09 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-f040b28d-deda-4c30-a6f3-5c0afc0a1718 tempest-CreateVolumesFromSnapshotTest-699277118 None] Created reservations ['b727c93c-9a36-4269-9f54-08283c126af5', 'b650148d-f790-412c-93fa-ceea151e71bc', '5b57e3d2-a924-4e3c-9299-af4254e48835', '0c89676a-0395-41c7-bfce-31d197dbcf58'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:47:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f040b28d-deda-4c30-a6f3-5c0afc0a1718 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f040b28d-deda-4c30-a6f3-5c0afc0a1718 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:09 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f040b28d-deda-4c30-a6f3-5c0afc0a1718 tempest-CreateVolumesFromSnapshotTest-699277118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:47:09 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f040b28d-deda-4c30-a6f3-5c0afc0a1718 tempest-CreateVolumesFromSnapshotTest-699277118 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:47:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f040b28d-deda-4c30-a6f3-5c0afc0a1718 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f040b28d-deda-4c30-a6f3-5c0afc0a1718 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f040b28d-deda-4c30-a6f3-5c0afc0a1718 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.106s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:09 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-f040b28d-deda-4c30-a6f3-5c0afc0a1718 tempest-CreateVolumesFromSnapshotTest-699277118 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:47:09 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-f040b28d-deda-4c30-a6f3-5c0afc0a1718 tempest-CreateVolumesFromSnapshotTest-699277118 None] Deleted volume successfully.
Sep 22 23:47:10 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-f040b28d-deda-4c30-a6f3-5c0afc0a1718 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-e3c54fe8-ead4-4c9a-94a8-c9498152339c-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:10 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "cinder-01f9d879-76e9-4250-b33b-79c123d53ff3-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:10 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-01f9d879-76e9-4250-b33b-79c123d53ff3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:10 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:47:10 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "cinder-quobyte-b75ef3d9-980a-46eb-85df-b5d64c7e7130" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:10 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-quobyte-b75ef3d9-980a-46eb-85df-b5d64c7e7130" acquired by "delete_snapshot" :: waited 0.013s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:10 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "cinder-quobyte-01f9d879-76e9-4250-b33b-79c123d53ff3" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:10 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-quobyte-01f9d879-76e9-4250-b33b-79c123d53ff3" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:10 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] Deleting offline snapshot 01f9d879-76e9-4250-b33b-79c123d53ff3 of volume b75ef3d9-980a-46eb-85df-b5d64c7e7130 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:47:10 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] snapshot_file for this snap is: volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.01f9d879-76e9-4250-b33b-79c123d53ff3 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:47:10 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4cfbfb-5d44-4bb3-929d-3c0c2bdb47f6]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:47:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.01f9d879-76e9-4250-b33b-79c123d53ff3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.01f9d879-76e9-4250-b33b-79c123d53ff3" returned: 0 in 0.380s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:11 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:47:11 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4613e6e-c03c-4915-8cdb-715fdd3ee30b]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:47:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:11 devstack quobyte-client[84065]: System call of process 101083 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:47:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130" returned: 0 in 0.397s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.01f9d879-76e9-4250-b33b-79c123d53ff3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.01f9d879-76e9-4250-b33b-79c123d53ff3" returned: 0 in 0.270s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.01f9d879-76e9-4250-b33b-79c123d53ff3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130.01f9d879-76e9-4250-b33b-79c123d53ff3" returned: 0 in 0.082s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-quobyte-01f9d879-76e9-4250-b33b-79c123d53ff3" released by "_delete_snapshot" :: held 1.442s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-quobyte-b75ef3d9-980a-46eb-85df-b5d64c7e7130" released by "delete_snapshot" :: held 1.466s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:12 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=68,cinder:UPDATE=91,cinder:DELETE=10,cinder:INSERT=14 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:47:12 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=116,cinder:SELECT=64,cinder:DELETE=12,cinder:INSERT=26 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:47:12 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] Created reservations ['8724019d-46a8-4507-8f29-4893f8df6794', '86af8b7e-450b-42c5-9712-5649385dcfcf', '4e0b55fe-7311-4b17-8842-958b5f737819', '7332c7da-90c7-43bc-94c5-146f505a98e6'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:47:12 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] Delete snapshot completed successfully.
Sep 22 23:47:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-fc274199-1209-44e7-bbbf-940c32c0002f tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-01f9d879-76e9-4250-b33b-79c123d53ff3-delete_snapshot" released by "delete_snapshot" :: held 1.924s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-febd0299-2044-4d35-b9c0-4fd3173f2f72 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "cinder-b75ef3d9-980a-46eb-85df-b5d64c7e7130-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-febd0299-2044-4d35-b9c0-4fd3173f2f72 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-b75ef3d9-980a-46eb-85df-b5d64c7e7130-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:12 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-febd0299-2044-4d35-b9c0-4fd3173f2f72 tempest-CreateVolumesFromSnapshotTest-699277118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:47:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-febd0299-2044-4d35-b9c0-4fd3173f2f72 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "cinder-quobyte-b75ef3d9-980a-46eb-85df-b5d64c7e7130" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-febd0299-2044-4d35-b9c0-4fd3173f2f72 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-quobyte-b75ef3d9-980a-46eb-85df-b5d64c7e7130" acquired by "delete_volume" :: waited 0.013s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:12 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[00065030-b897-4049-814d-acbe93497bb5]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:47:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-febd0299-2044-4d35-b9c0-4fd3173f2f72 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-febd0299-2044-4d35-b9c0-4fd3173f2f72 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130" returned: 0 in 0.398s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-febd0299-2044-4d35-b9c0-4fd3173f2f72 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-febd0299-2044-4d35-b9c0-4fd3173f2f72 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b75ef3d9-980a-46eb-85df-b5d64c7e7130" returned: 0 in 0.116s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:13 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-febd0299-2044-4d35-b9c0-4fd3173f2f72 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-quobyte-b75ef3d9-980a-46eb-85df-b5d64c7e7130" released by "delete_volume" :: held 0.680s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:13 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-febd0299-2044-4d35-b9c0-4fd3173f2f72 tempest-CreateVolumesFromSnapshotTest-699277118 None] Created reservations ['b8e9d20a-331e-4b47-b5b9-9084b8b63553', '2157f669-31e8-401e-af4f-ccd89d199db4', 'aff6e635-8942-4c7a-a2bc-ee382b09b8bf', '34efc801-c8ec-4a82-854f-14df68b08183'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:47:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-febd0299-2044-4d35-b9c0-4fd3173f2f72 tempest-CreateVolumesFromSnapshotTest-699277118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-febd0299-2044-4d35-b9c0-4fd3173f2f72 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-febd0299-2044-4d35-b9c0-4fd3173f2f72 tempest-CreateVolumesFromSnapshotTest-699277118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:47:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-febd0299-2044-4d35-b9c0-4fd3173f2f72 tempest-CreateVolumesFromSnapshotTest-699277118 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:47:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-febd0299-2044-4d35-b9c0-4fd3173f2f72 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-febd0299-2044-4d35-b9c0-4fd3173f2f72 tempest-CreateVolumesFromSnapshotTest-699277118 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-febd0299-2044-4d35-b9c0-4fd3173f2f72 tempest-CreateVolumesFromSnapshotTest-699277118 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.082s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:14 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-febd0299-2044-4d35-b9c0-4fd3173f2f72 tempest-CreateVolumesFromSnapshotTest-699277118 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:47:14 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-febd0299-2044-4d35-b9c0-4fd3173f2f72 tempest-CreateVolumesFromSnapshotTest-699277118 None] Deleted volume successfully.
Sep 22 23:47:14 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-febd0299-2044-4d35-b9c0-4fd3173f2f72 tempest-CreateVolumesFromSnapshotTest-699277118 None] Lock "cinder-b75ef3d9-980a-46eb-85df-b5d64c7e7130-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:17 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Flow 'volume_create_manager' (919787b7-e879-4161-baf2-f7ff82348f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0056be79-ffe0-41e9-8e0f-66ffd571cc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0056be79-ffe0-41e9-8e0f-66ffd571cc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-451822363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a54a5b9-85cc-4829-b6b8-fc76be0026a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924a298c719b440fb54b318bbd2a4079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:47:17Z,use_quota=True,user_id='340d40268b604f72b0c4642b62b770dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6fa60ee-8fd0-42a8-badc-78810fcc7ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6fa60ee-8fd0-42a8-badc-78810fcc7ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1b2d359-ecb9-40ba-8f44-01d403a4017d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1b2d359-ecb9-40ba-8f44-01d403a4017d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a54a5b9-85cc-4829-b6b8-fc76be0026a2', 'volume_name': 'volume-0a54a5b9-85cc-4829-b6b8-fc76be0026a2', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db71ebea-bff4-477b-8354-b0620e3683b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db71ebea-bff4-477b-8354-b0620e3683b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e35fcc-4b49-4688-b817-d73071355b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:17 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume 0a54a5b9-85cc-4829-b6b8-fc76be0026a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a54a5b9-85cc-4829-b6b8-fc76be0026a2', 'volume_size': 1}
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-451822363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a54a5b9-85cc-4829-b6b8-fc76be0026a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924a298c719b440fb54b318bbd2a4079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:47:17Z,use_quota=True,user_id='340d40268b604f72b0c4642b62b770dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Creating volume 0a54a5b9-85cc-4829-b6b8-fc76be0026a2 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:47:17 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:47:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0a54a5b9-85cc-4829-b6b8-fc76be0026a2 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:17 devstack quobyte-client[84065]: System call of process 101096 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:47:17 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=136, name=volume-0a54a5b9-85cc-4829-b6b8-fc76be0026a2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:47:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0a54a5b9-85cc-4829-b6b8-fc76be0026a2 1073741824" returned: 0 in 0.364s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0a54a5b9-85cc-4829-b6b8-fc76be0026a2 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0a54a5b9-85cc-4829-b6b8-fc76be0026a2" returned: 0 in 0.090s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] <== create_volume: return (521ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:47:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.533s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e35fcc-4b49-4688-b817-d73071355b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a54a5b9-85cc-4829-b6b8-fc76be0026a2', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0a6012-0051-45c3-a4df-79689a58ad6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:18 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume volume-0a54a5b9-85cc-4829-b6b8-fc76be0026a2 (0a54a5b9-85cc-4829-b6b8-fc76be0026a2): created successfully
Sep 22 23:47:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0a6012-0051-45c3-a4df-79689a58ad6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:18 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Flow 'volume_create_manager' (919787b7-e879-4161-baf2-f7ff82348f4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:47:18 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-6efd7b71-38e3-4ca7-a984-66c245e19823 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Created volume successfully.
Sep 22 23:47:20 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Flow 'volume_create_manager' (10ade3a7-b663-4e7c-bb7f-59f5431a64f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (254b35ca-b651-4525-a9c5-66db540330db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (254b35ca-b651-4525-a9c5-66db540330db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1105639098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924a298c719b440fb54b318bbd2a4079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:47:20Z,use_quota=True,user_id='340d40268b604f72b0c4642b62b770dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0e174c-b2b4-4e6a-8226-e7e63878db1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0e174c-b2b4-4e6a-8226-e7e63878db1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1684e1-cd69-41d2-9296-6f81fa3fab71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1684e1-cd69-41d2-9296-6f81fa3fab71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8', 'volume_name': 'volume-c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0914cf-5d3a-4f40-abd3-f1dc254711db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0914cf-5d3a-4f40-abd3-f1dc254711db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28cc9bad-a8d8-4450-9d10-f9a402abbf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:20 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8', 'volume_size': 1}
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1105639098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924a298c719b440fb54b318bbd2a4079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:47:20Z,use_quota=True,user_id='340d40268b604f72b0c4642b62b770dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Creating volume c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:47:20 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:20 devstack quobyte-client[84065]: System call of process 101100 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:47:20 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=137, name=volume-c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:47:20 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:47:20 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Flow 'volume_create_manager' (3b5e15fb-7286-4c35-8e75-f7c99d716711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0fa01c-4e8b-4309-b830-37f16b4c625f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8 1073741824" returned: 0 in 0.711s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0fa01c-4e8b-4309-b830-37f16b4c625f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-730330092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2828a7-fe99-4c31-aced-de637e9c5e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924a298c719b440fb54b318bbd2a4079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:47:20Z,use_quota=True,user_id='340d40268b604f72b0c4642b62b770dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f8e1e0-d836-483b-90bf-8dd2e6431001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f8e1e0-d836-483b-90bf-8dd2e6431001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450374b1-d8ee-4fff-b06f-cfeaf7b5b62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450374b1-d8ee-4fff-b06f-cfeaf7b5b62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac2828a7-fe99-4c31-aced-de637e9c5e09', 'volume_name': 'volume-ac2828a7-fe99-4c31-aced-de637e9c5e09', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a473f9c-328c-4f1c-9a37-380d4e5013ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a473f9c-328c-4f1c-9a37-380d4e5013ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b5f596-d541-406b-8836-82a3c1853f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:21 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume ac2828a7-fe99-4c31-aced-de637e9c5e09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac2828a7-fe99-4c31-aced-de637e9c5e09', 'volume_size': 1}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:21 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Flow 'volume_create_manager' (3cc786f7-6f44-4c11-9ea7-287ac8c7b8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f78d9f-124b-40f8-b068-ac7c8b008774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8" returned: 0 in 0.593s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] <== create_volume: return (1329ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.344s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-730330092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2828a7-fe99-4c31-aced-de637e9c5e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924a298c719b440fb54b318bbd2a4079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:47:20Z,use_quota=True,user_id='340d40268b604f72b0c4642b62b770dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Creating volume ac2828a7-fe99-4c31-aced-de637e9c5e09 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:47:21 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:47:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ac2828a7-fe99-4c31-aced-de637e9c5e09 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:21 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=138, name=volume-ac2828a7-fe99-4c31-aced-de637e9c5e09, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f78d9f-124b-40f8-b068-ac7c8b008774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1162729979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07b21639-6300-4ca0-a6d1-f47c14571eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924a298c719b440fb54b318bbd2a4079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:47:21Z,use_quota=True,user_id='340d40268b604f72b0c4642b62b770dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3875242-cf29-48cb-adf8-41dca0ced75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3875242-cf29-48cb-adf8-41dca0ced75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd771a61-5d57-4bfd-8970-524f1bf61702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd771a61-5d57-4bfd-8970-524f1bf61702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07b21639-6300-4ca0-a6d1-f47c14571eee', 'volume_name': 'volume-07b21639-6300-4ca0-a6d1-f47c14571eee', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165a061f-aa1e-4607-a8a0-c664ad2c4019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165a061f-aa1e-4607-a8a0-c664ad2c4019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ad4a50-9d33-41c0-8e5b-722a48da0adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:22 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume 07b21639-6300-4ca0-a6d1-f47c14571eee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07b21639-6300-4ca0-a6d1-f47c14571eee', 'volume_size': 1}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:22 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Flow 'volume_create_manager' (e7c52f9d-6d3c-47fe-825a-02ed464aa2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8f8e17-23c2-406c-a4dd-d90746c96a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:22 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Flow 'volume_create_manager' (4ec53b16-bf31-4b85-bd36-cd44c635242d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d27709-e409-4ef4-a6a5-93adaad8cc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28cc9bad-a8d8-4450-9d10-f9a402abbf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde636c5-62a2-4f60-8040-e3dfe3223d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ac2828a7-fe99-4c31-aced-de637e9c5e09 1073741824" returned: 0 in 0.704s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ac2828a7-fe99-4c31-aced-de637e9c5e09 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8f8e17-23c2-406c-a4dd-d90746c96a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-180770227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0a4700-6e1b-438e-8260-476f8afd8471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924a298c719b440fb54b318bbd2a4079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:47:21Z,use_quota=True,user_id='340d40268b604f72b0c4642b62b770dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7c044c-89da-4d3b-aca4-451316594723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7c044c-89da-4d3b-aca4-451316594723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981f392f-4b9a-4b21-a1a0-761cdd4a161e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (981f392f-4b9a-4b21-a1a0-761cdd4a161e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa0a4700-6e1b-438e-8260-476f8afd8471', 'volume_name': 'volume-aa0a4700-6e1b-438e-8260-476f8afd8471', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a484f9-c0c9-456e-a764-b4e79543b4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a484f9-c0c9-456e-a764-b4e79543b4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd64a831-9101-449e-9177-bcc724f3e3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:22 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume aa0a4700-6e1b-438e-8260-476f8afd8471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa0a4700-6e1b-438e-8260-476f8afd8471', 'volume_size': 1}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d27709-e409-4ef4-a6a5-93adaad8cc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-152730675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b521a060-f777-4239-9536-a5705fe5391a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924a298c719b440fb54b318bbd2a4079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:47:22Z,use_quota=True,user_id='340d40268b604f72b0c4642b62b770dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8444f1c9-c3df-4b61-9ed2-d5bb8b247417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8444f1c9-c3df-4b61-9ed2-d5bb8b247417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df271a9f-8599-4e7e-a12d-8c4437fe1ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df271a9f-8599-4e7e-a12d-8c4437fe1ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b521a060-f777-4239-9536-a5705fe5391a', 'volume_name': 'volume-b521a060-f777-4239-9536-a5705fe5391a', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31960eba-ca1c-45af-bb84-87129e018b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31960eba-ca1c-45af-bb84-87129e018b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4d08ee-3a74-4e70-ae83-ad175ce37153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:22 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume b521a060-f777-4239-9536-a5705fe5391a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b521a060-f777-4239-9536-a5705fe5391a', 'volume_size': 1}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:22 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume volume-c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8 (c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8): created successfully
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde636c5-62a2-4f60-8040-e3dfe3223d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Flow 'volume_create_manager' (10ade3a7-b663-4e7c-bb7f-59f5431a64f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ac2828a7-fe99-4c31-aced-de637e9c5e09" returned: 0 in 0.478s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] <== create_volume: return (1203ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.827s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1162729979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07b21639-6300-4ca0-a6d1-f47c14571eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924a298c719b440fb54b318bbd2a4079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:47:21Z,use_quota=True,user_id='340d40268b604f72b0c4642b62b770dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Creating volume 07b21639-6300-4ca0-a6d1-f47c14571eee {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:22 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:47:23 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-07b21639-6300-4ca0-a6d1-f47c14571eee 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:23 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-76112f25-0559-4bbe-83a1-946b1fc949fb tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Created volume successfully.
Sep 22 23:47:23 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=139, name=volume-07b21639-6300-4ca0-a6d1-f47c14571eee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b5f596-d541-406b-8836-82a3c1853f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac2828a7-fe99-4c31-aced-de637e9c5e09', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e0a57b-7824-4527-871c-0a70e0a6db41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:23 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume volume-ac2828a7-fe99-4c31-aced-de637e9c5e09 (ac2828a7-fe99-4c31-aced-de637e9c5e09): created successfully
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e0a57b-7824-4527-871c-0a70e0a6db41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Flow 'volume_create_manager' (3b5e15fb-7286-4c35-8e75-f7c99d716711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-07b21639-6300-4ca0-a6d1-f47c14571eee 1073741824" returned: 0 in 0.470s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-07b21639-6300-4ca0-a6d1-f47c14571eee {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:23 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-ac6b8cfc-4135-43ad-949f-2f7d4eb69895 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Created volume successfully.
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-07b21639-6300-4ca0-a6d1-f47c14571eee" returned: 0 in 0.225s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] <== create_volume: return (724ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.983s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-180770227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0a4700-6e1b-438e-8260-476f8afd8471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924a298c719b440fb54b318bbd2a4079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:47:21Z,use_quota=True,user_id='340d40268b604f72b0c4642b62b770dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Creating volume aa0a4700-6e1b-438e-8260-476f8afd8471 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:47:23 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:47:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa0a4700-6e1b-438e-8260-476f8afd8471 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:23 devstack quobyte-client[84065]: System call of process 101112 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:47:24 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=140, name=volume-aa0a4700-6e1b-438e-8260-476f8afd8471, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ad4a50-9d33-41c0-8e5b-722a48da0adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07b21639-6300-4ca0-a6d1-f47c14571eee', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc81bae0-3d3b-4b49-84cd-c2bfd140d457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa0a4700-6e1b-438e-8260-476f8afd8471 1073741824" returned: 0 in 0.437s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa0a4700-6e1b-438e-8260-476f8afd8471 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:24 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume volume-07b21639-6300-4ca0-a6d1-f47c14571eee (07b21639-6300-4ca0-a6d1-f47c14571eee): created successfully
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc81bae0-3d3b-4b49-84cd-c2bfd140d457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Flow 'volume_create_manager' (3cc786f7-6f44-4c11-9ea7-287ac8c7b8cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa0a4700-6e1b-438e-8260-476f8afd8471" returned: 0 in 0.297s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] <== create_volume: return (770ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.734s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-152730675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b521a060-f777-4239-9536-a5705fe5391a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='924a298c719b440fb54b318bbd2a4079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:47:22Z,use_quota=True,user_id='340d40268b604f72b0c4642b62b770dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Creating volume b521a060-f777-4239-9536-a5705fe5391a {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:47:24 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b521a060-f777-4239-9536-a5705fe5391a 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:24 devstack quobyte-client[84065]: System call of process 101116 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:47:24 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=141, name=volume-b521a060-f777-4239-9536-a5705fe5391a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd64a831-9101-449e-9177-bcc724f3e3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa0a4700-6e1b-438e-8260-476f8afd8471', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd11e59c-e58d-4dc1-8b8f-8e6f60a5ffea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:24 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-06fc949c-74fd-47bb-854d-44cf5aa8d9c3 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Created volume successfully.
Sep 22 23:47:24 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume volume-aa0a4700-6e1b-438e-8260-476f8afd8471 (aa0a4700-6e1b-438e-8260-476f8afd8471): created successfully
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd11e59c-e58d-4dc1-8b8f-8e6f60a5ffea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:24 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Flow 'volume_create_manager' (e7c52f9d-6d3c-47fe-825a-02ed464aa2ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:47:25 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-451ad7d2-c984-4885-91ab-48c4d559a839 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Created volume successfully.
Sep 22 23:47:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b521a060-f777-4239-9536-a5705fe5391a 1073741824" returned: 0 in 0.486s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b521a060-f777-4239-9536-a5705fe5391a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b521a060-f777-4239-9536-a5705fe5391a" returned: 0 in 0.144s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:25 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] <== create_volume: return (680ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:47:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:25 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4d08ee-3a74-4e70-ae83-ad175ce37153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b521a060-f777-4239-9536-a5705fe5391a', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:25 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbd1a36-292d-4c20-a208-52f8eba948df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:47:25 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume volume-b521a060-f777-4239-9536-a5705fe5391a (b521a060-f777-4239-9536-a5705fe5391a): created successfully
Sep 22 23:47:25 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbd1a36-292d-4c20-a208-52f8eba948df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:47:25 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Flow 'volume_create_manager' (4ec53b16-bf31-4b85-bd36-cd44c635242d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:47:25 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-11f46fbf-ab90-4663-a338-96170c8cb0a1 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Created volume successfully.
Sep 22 23:47:26 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a77557d4-4cd1-4e41-87ca-2cd475f3be00 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "cinder-b521a060-f777-4239-9536-a5705fe5391a-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:26 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a77557d4-4cd1-4e41-87ca-2cd475f3be00 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-b521a060-f777-4239-9536-a5705fe5391a-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:26 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-a77557d4-4cd1-4e41-87ca-2cd475f3be00 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:47:26 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a77557d4-4cd1-4e41-87ca-2cd475f3be00 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "cinder-quobyte-b521a060-f777-4239-9536-a5705fe5391a" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:26 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a77557d4-4cd1-4e41-87ca-2cd475f3be00 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-quobyte-b521a060-f777-4239-9536-a5705fe5391a" acquired by "delete_volume" :: waited 0.014s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:26 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d6dc79-f128-4bb6-8401-60aff6109ff9]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:47:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a77557d4-4cd1-4e41-87ca-2cd475f3be00 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b521a060-f777-4239-9536-a5705fe5391a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a77557d4-4cd1-4e41-87ca-2cd475f3be00 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b521a060-f777-4239-9536-a5705fe5391a" returned: 0 in 0.419s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a77557d4-4cd1-4e41-87ca-2cd475f3be00 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b521a060-f777-4239-9536-a5705fe5391a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a77557d4-4cd1-4e41-87ca-2cd475f3be00 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-b521a060-f777-4239-9536-a5705fe5391a" returned: 0 in 0.087s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:27 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a77557d4-4cd1-4e41-87ca-2cd475f3be00 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-quobyte-b521a060-f777-4239-9536-a5705fe5391a" released by "delete_volume" :: held 0.673s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:27 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-a77557d4-4cd1-4e41-87ca-2cd475f3be00 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Created reservations ['0fa405dc-75b0-4086-8511-de3e2827c0ee', 'f6934f3d-7fe2-4487-adb9-4eb79db1bd14', '3cb3e65c-85bc-4596-b36f-30c8700aee5d', 'add70c3b-694d-47c7-b433-c08b86ed4e06'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:47:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a77557d4-4cd1-4e41-87ca-2cd475f3be00 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a77557d4-4cd1-4e41-87ca-2cd475f3be00 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a77557d4-4cd1-4e41-87ca-2cd475f3be00 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:47:27 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-a77557d4-4cd1-4e41-87ca-2cd475f3be00 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:47:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-a77557d4-4cd1-4e41-87ca-2cd475f3be00 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a77557d4-4cd1-4e41-87ca-2cd475f3be00 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-a77557d4-4cd1-4e41-87ca-2cd475f3be00 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.092s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:27 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-a77557d4-4cd1-4e41-87ca-2cd475f3be00 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:47:27 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-a77557d4-4cd1-4e41-87ca-2cd475f3be00 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Deleted volume successfully.
Sep 22 23:47:28 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-a77557d4-4cd1-4e41-87ca-2cd475f3be00 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-b521a060-f777-4239-9536-a5705fe5391a-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:28 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2cff6972-d76a-4fd4-8fc3-4b9f5ae4bdec tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "cinder-aa0a4700-6e1b-438e-8260-476f8afd8471-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:28 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2cff6972-d76a-4fd4-8fc3-4b9f5ae4bdec tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-aa0a4700-6e1b-438e-8260-476f8afd8471-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:28 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-2cff6972-d76a-4fd4-8fc3-4b9f5ae4bdec tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:47:28 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2cff6972-d76a-4fd4-8fc3-4b9f5ae4bdec tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "cinder-quobyte-aa0a4700-6e1b-438e-8260-476f8afd8471" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:28 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2cff6972-d76a-4fd4-8fc3-4b9f5ae4bdec tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-quobyte-aa0a4700-6e1b-438e-8260-476f8afd8471" acquired by "delete_volume" :: waited 0.012s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:28 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36239cf-b083-40f0-8e63-bda19e17044d]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:47:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2cff6972-d76a-4fd4-8fc3-4b9f5ae4bdec tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa0a4700-6e1b-438e-8260-476f8afd8471 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:29 devstack quobyte-client[84065]: System call of process 101128 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:47:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2cff6972-d76a-4fd4-8fc3-4b9f5ae4bdec tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa0a4700-6e1b-438e-8260-476f8afd8471" returned: 0 in 0.397s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2cff6972-d76a-4fd4-8fc3-4b9f5ae4bdec tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa0a4700-6e1b-438e-8260-476f8afd8471 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2cff6972-d76a-4fd4-8fc3-4b9f5ae4bdec tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa0a4700-6e1b-438e-8260-476f8afd8471" returned: 0 in 0.091s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:29 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2cff6972-d76a-4fd4-8fc3-4b9f5ae4bdec tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-quobyte-aa0a4700-6e1b-438e-8260-476f8afd8471" released by "delete_volume" :: held 0.652s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:29 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-2cff6972-d76a-4fd4-8fc3-4b9f5ae4bdec tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Created reservations ['b85bc8a5-6bbc-43eb-a0e6-185b94dfdb73', 'f93235d2-c561-422d-906b-0490a5ba38f0', '1e97e18a-b1b1-4453-a926-4f62d870067f', '827d6953-b460-49f3-8221-e78b42351626'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:47:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2cff6972-d76a-4fd4-8fc3-4b9f5ae4bdec tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2cff6972-d76a-4fd4-8fc3-4b9f5ae4bdec tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-2cff6972-d76a-4fd4-8fc3-4b9f5ae4bdec tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:47:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-2cff6972-d76a-4fd4-8fc3-4b9f5ae4bdec tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:47:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2cff6972-d76a-4fd4-8fc3-4b9f5ae4bdec tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2cff6972-d76a-4fd4-8fc3-4b9f5ae4bdec tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2cff6972-d76a-4fd4-8fc3-4b9f5ae4bdec tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.085s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:30 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-2cff6972-d76a-4fd4-8fc3-4b9f5ae4bdec tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:47:30 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-2cff6972-d76a-4fd4-8fc3-4b9f5ae4bdec tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Deleted volume successfully.
Sep 22 23:47:30 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-2cff6972-d76a-4fd4-8fc3-4b9f5ae4bdec tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-aa0a4700-6e1b-438e-8260-476f8afd8471-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:30 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-27ac98e9-4000-4fac-b976-fc34aabac9cc tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "cinder-07b21639-6300-4ca0-a6d1-f47c14571eee-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:31 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-27ac98e9-4000-4fac-b976-fc34aabac9cc tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-07b21639-6300-4ca0-a6d1-f47c14571eee-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:31 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-27ac98e9-4000-4fac-b976-fc34aabac9cc tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:47:31 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-27ac98e9-4000-4fac-b976-fc34aabac9cc tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "cinder-quobyte-07b21639-6300-4ca0-a6d1-f47c14571eee" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:31 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-27ac98e9-4000-4fac-b976-fc34aabac9cc tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-quobyte-07b21639-6300-4ca0-a6d1-f47c14571eee" acquired by "delete_volume" :: waited 0.014s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:31 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a811f5-3279-44d8-9f65-4e1392fc0aec]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:47:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-27ac98e9-4000-4fac-b976-fc34aabac9cc tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-07b21639-6300-4ca0-a6d1-f47c14571eee {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-27ac98e9-4000-4fac-b976-fc34aabac9cc tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-07b21639-6300-4ca0-a6d1-f47c14571eee" returned: 0 in 0.404s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-27ac98e9-4000-4fac-b976-fc34aabac9cc tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-07b21639-6300-4ca0-a6d1-f47c14571eee {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-27ac98e9-4000-4fac-b976-fc34aabac9cc tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-07b21639-6300-4ca0-a6d1-f47c14571eee" returned: 0 in 0.098s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:31 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-27ac98e9-4000-4fac-b976-fc34aabac9cc tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-quobyte-07b21639-6300-4ca0-a6d1-f47c14571eee" released by "delete_volume" :: held 0.672s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:32 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-27ac98e9-4000-4fac-b976-fc34aabac9cc tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Created reservations ['f33ae9f7-0769-4e78-9333-72e26e433dda', '911dd7bf-20f1-4c8b-9554-474821ccd90d', '74160d51-fead-47d6-8358-a4eaca21e610', '2b3fb459-4d48-4d53-8b19-3b7ae784912b'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:47:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-27ac98e9-4000-4fac-b976-fc34aabac9cc tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-27ac98e9-4000-4fac-b976-fc34aabac9cc tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:32 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-27ac98e9-4000-4fac-b976-fc34aabac9cc tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:47:32 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-27ac98e9-4000-4fac-b976-fc34aabac9cc tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:47:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-27ac98e9-4000-4fac-b976-fc34aabac9cc tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-27ac98e9-4000-4fac-b976-fc34aabac9cc tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-27ac98e9-4000-4fac-b976-fc34aabac9cc tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.081s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:32 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-27ac98e9-4000-4fac-b976-fc34aabac9cc tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:47:32 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-27ac98e9-4000-4fac-b976-fc34aabac9cc tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Deleted volume successfully.
Sep 22 23:47:32 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-27ac98e9-4000-4fac-b976-fc34aabac9cc tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-07b21639-6300-4ca0-a6d1-f47c14571eee-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:33 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b9f7fc55-b603-47b9-bd25-a72b1024de9a tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "cinder-ac2828a7-fe99-4c31-aced-de637e9c5e09-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:33 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b9f7fc55-b603-47b9-bd25-a72b1024de9a tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-ac2828a7-fe99-4c31-aced-de637e9c5e09-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:33 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-b9f7fc55-b603-47b9-bd25-a72b1024de9a tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:47:33 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b9f7fc55-b603-47b9-bd25-a72b1024de9a tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "cinder-quobyte-ac2828a7-fe99-4c31-aced-de637e9c5e09" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:33 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b9f7fc55-b603-47b9-bd25-a72b1024de9a tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-quobyte-ac2828a7-fe99-4c31-aced-de637e9c5e09" acquired by "delete_volume" :: waited 0.011s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:33 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9ffa98-0875-4102-86ce-c45463b09874]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:47:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b9f7fc55-b603-47b9-bd25-a72b1024de9a tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ac2828a7-fe99-4c31-aced-de637e9c5e09 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b9f7fc55-b603-47b9-bd25-a72b1024de9a tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ac2828a7-fe99-4c31-aced-de637e9c5e09" returned: 0 in 0.410s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b9f7fc55-b603-47b9-bd25-a72b1024de9a tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ac2828a7-fe99-4c31-aced-de637e9c5e09 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b9f7fc55-b603-47b9-bd25-a72b1024de9a tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ac2828a7-fe99-4c31-aced-de637e9c5e09" returned: 0 in 0.091s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:34 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b9f7fc55-b603-47b9-bd25-a72b1024de9a tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-quobyte-ac2828a7-fe99-4c31-aced-de637e9c5e09" released by "delete_volume" :: held 0.672s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:34 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-b9f7fc55-b603-47b9-bd25-a72b1024de9a tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Created reservations ['a2963a2b-1dfd-4b35-b946-9ed009910a3f', '9ec65a9f-822a-43c1-9ad7-9fc4a4dcf4ca', '1dcb0056-4a5c-4480-8d7a-fdeb09e8ebc4', '701e51b9-b838-4f4c-959f-49b47e28934d'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:47:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b9f7fc55-b603-47b9-bd25-a72b1024de9a tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b9f7fc55-b603-47b9-bd25-a72b1024de9a tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:34 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b9f7fc55-b603-47b9-bd25-a72b1024de9a tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:47:34 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b9f7fc55-b603-47b9-bd25-a72b1024de9a tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:47:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b9f7fc55-b603-47b9-bd25-a72b1024de9a tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b9f7fc55-b603-47b9-bd25-a72b1024de9a tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b9f7fc55-b603-47b9-bd25-a72b1024de9a tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.083s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:34 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-b9f7fc55-b603-47b9-bd25-a72b1024de9a tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:47:34 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-b9f7fc55-b603-47b9-bd25-a72b1024de9a tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Deleted volume successfully.
Sep 22 23:47:34 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b9f7fc55-b603-47b9-bd25-a72b1024de9a tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-ac2828a7-fe99-4c31-aced-de637e9c5e09-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:35 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-91337685-3fa8-4e2c-ba2e-f67bd81f10c6 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "cinder-c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:35 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-91337685-3fa8-4e2c-ba2e-f67bd81f10c6 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:35 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-91337685-3fa8-4e2c-ba2e-f67bd81f10c6 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:47:35 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-91337685-3fa8-4e2c-ba2e-f67bd81f10c6 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "cinder-quobyte-c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:35 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-91337685-3fa8-4e2c-ba2e-f67bd81f10c6 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-quobyte-c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8" acquired by "delete_volume" :: waited 0.013s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:35 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af1d1ae-b6be-4225-a191-791e7683970d]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:47:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-91337685-3fa8-4e2c-ba2e-f67bd81f10c6 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-91337685-3fa8-4e2c-ba2e-f67bd81f10c6 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8" returned: 0 in 0.400s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-91337685-3fa8-4e2c-ba2e-f67bd81f10c6 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-91337685-3fa8-4e2c-ba2e-f67bd81f10c6 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8" returned: 0 in 0.093s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:36 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-91337685-3fa8-4e2c-ba2e-f67bd81f10c6 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-quobyte-c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8" released by "delete_volume" :: held 0.666s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:36 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-91337685-3fa8-4e2c-ba2e-f67bd81f10c6 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Created reservations ['dddd02bd-5085-4d28-b306-af82efb123d3', '68883062-1325-4788-ac53-a8eaf4c031a1', '9d688820-2f60-44be-ba8b-0f6a692612c7', '55fa74d5-48d3-4228-bf16-9a615ac4eb3b'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:47:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-91337685-3fa8-4e2c-ba2e-f67bd81f10c6 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-91337685-3fa8-4e2c-ba2e-f67bd81f10c6 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-91337685-3fa8-4e2c-ba2e-f67bd81f10c6 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:47:36 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-91337685-3fa8-4e2c-ba2e-f67bd81f10c6 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:47:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-91337685-3fa8-4e2c-ba2e-f67bd81f10c6 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-91337685-3fa8-4e2c-ba2e-f67bd81f10c6 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-91337685-3fa8-4e2c-ba2e-f67bd81f10c6 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.090s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:36 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-91337685-3fa8-4e2c-ba2e-f67bd81f10c6 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:47:37 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-91337685-3fa8-4e2c-ba2e-f67bd81f10c6 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Deleted volume successfully.
Sep 22 23:47:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-91337685-3fa8-4e2c-ba2e-f67bd81f10c6 tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-c513a881-fe0f-4214-bcc5-d0b8fd4ff4f8-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5ad8143a-c4a0-47cd-8c13-fbc512c8cb3c tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "cinder-0a54a5b9-85cc-4829-b6b8-fc76be0026a2-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5ad8143a-c4a0-47cd-8c13-fbc512c8cb3c tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-0a54a5b9-85cc-4829-b6b8-fc76be0026a2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:38 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-5ad8143a-c4a0-47cd-8c13-fbc512c8cb3c tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:47:38 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5ad8143a-c4a0-47cd-8c13-fbc512c8cb3c tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "cinder-quobyte-0a54a5b9-85cc-4829-b6b8-fc76be0026a2" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:47:38 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5ad8143a-c4a0-47cd-8c13-fbc512c8cb3c tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-quobyte-0a54a5b9-85cc-4829-b6b8-fc76be0026a2" acquired by "delete_volume" :: waited 0.011s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:47:38 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c390ae6-1eb6-4f55-8ac6-3b6a0c52ba98]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:47:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ad8143a-c4a0-47cd-8c13-fbc512c8cb3c tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0a54a5b9-85cc-4829-b6b8-fc76be0026a2 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ad8143a-c4a0-47cd-8c13-fbc512c8cb3c tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0a54a5b9-85cc-4829-b6b8-fc76be0026a2" returned: 0 in 0.396s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ad8143a-c4a0-47cd-8c13-fbc512c8cb3c tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0a54a5b9-85cc-4829-b6b8-fc76be0026a2 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ad8143a-c4a0-47cd-8c13-fbc512c8cb3c tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0a54a5b9-85cc-4829-b6b8-fc76be0026a2" returned: 0 in 0.101s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:38 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5ad8143a-c4a0-47cd-8c13-fbc512c8cb3c tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-quobyte-0a54a5b9-85cc-4829-b6b8-fc76be0026a2" released by "delete_volume" :: held 0.665s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:38 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-5ad8143a-c4a0-47cd-8c13-fbc512c8cb3c tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Created reservations ['3302d470-3003-4d39-894d-da71b9d7f680', 'bdb19323-b6d7-466c-9aea-300765ded333', '227158ee-21be-4fa6-959c-d20a019c281f', 'ed8e75ce-d727-46eb-a751-9ee9378844c4'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:47:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5ad8143a-c4a0-47cd-8c13-fbc512c8cb3c tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5ad8143a-c4a0-47cd-8c13-fbc512c8cb3c tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5ad8143a-c4a0-47cd-8c13-fbc512c8cb3c tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:47:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5ad8143a-c4a0-47cd-8c13-fbc512c8cb3c tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:47:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5ad8143a-c4a0-47cd-8c13-fbc512c8cb3c tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ad8143a-c4a0-47cd-8c13-fbc512c8cb3c tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5ad8143a-c4a0-47cd-8c13-fbc512c8cb3c tempest-CreateVolumesFromSourceVolumeTest-637521899 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.082s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:39 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-5ad8143a-c4a0-47cd-8c13-fbc512c8cb3c tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:47:39 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-5ad8143a-c4a0-47cd-8c13-fbc512c8cb3c tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Deleted volume successfully.
Sep 22 23:47:39 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-5ad8143a-c4a0-47cd-8c13-fbc512c8cb3c tempest-CreateVolumesFromSourceVolumeTest-637521899 None] Lock "cinder-0a54a5b9-85cc-4829-b6b8-fc76be0026a2-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:47:48 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:47:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:47:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:47:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:47:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:47:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:47:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:47:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.192s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:47:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:47:49 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:INSERT=18,cinder:UPDATE=76,cinder:SELECT=38,cinder:DELETE=7 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:47:49 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=71,cinder:SELECT=47,cinder:INSERT=14,cinder:DELETE=6 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:48:05 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Flow 'volume_create_manager' (44e82eee-0bee-4b00-817c-d9d341945c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d440e0-f7bc-4c96-bc8b-240ca0136bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d440e0-f7bc-4c96-bc8b-240ca0136bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-637429580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ac3391-4476-4a98-be3e-f598dc110879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='928fe512e6ba4b709c031cdc8fccc279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:48:05Z,use_quota=True,user_id='9af11a4e981f45e280e3d44846e6f8a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2ce09c-3b65-43e5-84e6-c7e41e42a913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2ce09c-3b65-43e5-84e6-c7e41e42a913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aff84a1-fbe6-471b-bcea-bb51d224c089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aff84a1-fbe6-471b-bcea-bb51d224c089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5ac3391-4476-4a98-be3e-f598dc110879', 'volume_name': 'volume-c5ac3391-4476-4a98-be3e-f598dc110879', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aacea5d-f1ab-4b2f-9c90-feba563e6dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aacea5d-f1ab-4b2f-9c90-feba563e6dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b24d6f6-e016-4c80-8ec0-c4e73f9d52b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:05 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Volume c5ac3391-4476-4a98-be3e-f598dc110879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5ac3391-4476-4a98-be3e-f598dc110879', 'volume_size': 1}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-637429580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ac3391-4476-4a98-be3e-f598dc110879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='928fe512e6ba4b709c031cdc8fccc279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:48:05Z,use_quota=True,user_id='9af11a4e981f45e280e3d44846e6f8a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Creating volume c5ac3391-4476-4a98-be3e-f598dc110879 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:48:05 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:05 devstack quobyte-client[84065]: System call of process 101198 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:48:05 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=142, name=volume-c5ac3391-4476-4a98-be3e-f598dc110879, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879 1073741824" returned: 0 in 0.412s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879" returned: 0 in 0.090s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] <== create_volume: return (621ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:48:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.636s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:48:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b24d6f6-e016-4c80-8ec0-c4e73f9d52b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5ac3391-4476-4a98-be3e-f598dc110879', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c05cda-f544-4272-a670-216040aabf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:06 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Volume volume-c5ac3391-4476-4a98-be3e-f598dc110879 (c5ac3391-4476-4a98-be3e-f598dc110879): created successfully
Sep 22 23:48:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c05cda-f544-4272-a670-216040aabf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Flow 'volume_create_manager' (44e82eee-0bee-4b00-817c-d9d341945c04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:48:06 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-38d619db-8f25-4c4d-89a6-3cce8b33add9 tempest-SnapshotDependencyTests-1151669366 None] Created volume successfully.
Sep 22 23:48:07 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:48:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:48:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:48:07 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] Creating offline snapshot 42ccdee6-5590-42c8-b3eb-919267d8cf99 of volume c5ac3391-4476-4a98-be3e-f598dc110879 {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:48:07 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a3255d-24dc-4551-b0ef-6ad9141c8b96]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:48:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:07 devstack quobyte-client[84065]: System call of process 101203 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:48:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879" returned: 0 in 0.436s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.42ccdee6-5590-42c8-b3eb-919267d8cf99 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:08 devstack quobyte-client[84065]: System call of process 101206 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:48:08 devstack quobyte-client[84065]: System call of process 101206 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:48:08 devstack quobyte-client[84065]: System call of process 101206 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:48:08 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=143, name=volume-c5ac3391-4476-4a98-be3e-f598dc110879.42ccdee6-5590-42c8-b3eb-919267d8cf99, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:48:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.42ccdee6-5590-42c8-b3eb-919267d8cf99 1G" returned: 0 in 0.262s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c5ac3391-4476-4a98-be3e-f598dc110879 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.42ccdee6-5590-42c8-b3eb-919267d8cf99 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:08 devstack quobyte-client[84065]: System call of process 101209 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:48:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] CMD "qemu-img rebase -u -b volume-c5ac3391-4476-4a98-be3e-f598dc110879 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.42ccdee6-5590-42c8-b3eb-919267d8cf99" returned: 0 in 0.183s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:08 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.42ccdee6-5590-42c8-b3eb-919267d8cf99 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:48:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.42ccdee6-5590-42c8-b3eb-919267d8cf99 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.42ccdee6-5590-42c8-b3eb-919267d8cf99" returned: 0 in 0.086s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:08 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879 -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:48:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.42ccdee6-5590-42c8-b3eb-919267d8cf99 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.42ccdee6-5590-42c8-b3eb-919267d8cf99" returned: 0 in 0.092s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.info" returned: 0 in 0.111s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:08 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.info is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:48:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.info" returned: 0 in 0.117s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.661s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:48:09 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-47395745-ba9d-40a8-8e62-8ba2d2b6926a tempest-SnapshotDependencyTests-1151669366 None] Create snapshot completed successfully
Sep 22 23:48:09 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:48:09 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Flow 'volume_create_manager' (c4e036ef-3d9d-4cb5-8f6e-a9788370e435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4858ffc6-44dc-4c04-b4aa-4cc43168d38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4858ffc6-44dc-4c04-b4aa-4cc43168d38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c46c6b-a6aa-4f71-8429-e81d22a6a985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='928fe512e6ba4b709c031cdc8fccc279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=42ccdee6-5590-42c8-b3eb-919267d8cf99,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:48:10Z,use_quota=True,user_id='9af11a4e981f45e280e3d44846e6f8a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (392975c1-401f-4d09-8e27-80f669991bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (392975c1-401f-4d09-8e27-80f669991bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64b3ef4-a074-4a1c-9701-e8114f274a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64b3ef4-a074-4a1c-9701-e8114f274a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd5c46c6b-a6aa-4f71-8429-e81d22a6a985', 'volume_name': 'volume-d5c46c6b-a6aa-4f71-8429-e81d22a6a985', 'volume_size': 1, 'snapshot_id': '42ccdee6-5590-42c8-b3eb-919267d8cf99'}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7baa7d-c527-4195-a678-f1537e3835de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7baa7d-c527-4195-a678-f1537e3835de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af2465ad-d7e3-4187-a72d-33800f7a30f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:10 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Volume d5c46c6b-a6aa-4f71-8429-e81d22a6a985: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d5c46c6b-a6aa-4f71-8429-e81d22a6a985', 'volume_size': 1, 'snapshot_id': '42ccdee6-5590-42c8-b3eb-919267d8cf99'}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Acquiring lock "cinder-quobyte-42ccdee6-5590-42c8-b3eb-919267d8cf99-d5c46c6b-a6aa-4f71-8429-e81d22a6a985" by "_create_volume_from_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Lock "cinder-quobyte-42ccdee6-5590-42c8-b3eb-919267d8cf99-d5c46c6b-a6aa-4f71-8429-e81d22a6a985" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Creating volume d5c46c6b-a6aa-4f71-8429-e81d22a6a985 from snapshot 42ccdee6-5590-42c8-b3eb-919267d8cf99 {{(pid=84012) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Acquiring lock "cinder-quobyte-d5c46c6b-a6aa-4f71-8429-e81d22a6a985" by "_copy_volume_from_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Lock "cinder-quobyte-d5c46c6b-a6aa-4f71-8429-e81d22a6a985" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] snapshot: 42ccdee6-5590-42c8-b3eb-919267d8cf99, volume: d5c46c6b-a6aa-4f71-8429-e81d22a6a985,  {{(pid=84012) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75e2821-0b61-4f58-a713-d0bc73804933]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.42ccdee6-5590-42c8-b3eb-919267d8cf99 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.42ccdee6-5590-42c8-b3eb-919267d8cf99" returned: 0 in 0.374s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5ac3391-4476-4a98-be3e-f598dc110879(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879 {{(pid=84012) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Creating direct copy from snapshot {{(pid=84012) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[495cd2b5-9d51-4eaf-86df-a1663c5024d2]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:48:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:11 devstack quobyte-client[84065]: System call of process 101219 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:48:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879" returned: 0 in 0.453s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:11 devstack cinder-volume[84012]: DEBUG cinder.utils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d5c46c6b-a6aa-4f71-8429-e81d22a6a985 not found in is_blk_device check {{(pid=84012) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 22 23:48:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d5c46c6b-a6aa-4f71-8429-e81d22a6a985 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:11 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=145, name=volume-d5c46c6b-a6aa-4f71-8429-e81d22a6a985, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:48:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d5c46c6b-a6aa-4f71-8429-e81d22a6a985" returned: 0 in 5.401s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:16 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[741e8548-aa06-4223-afb7-99fd986cb6d0]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:48:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879" returned: 0 in 0.548s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:17 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Image conversion details: src /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879, size 1024.00 MB, duration 5.43 sec, destination /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d5c46c6b-a6aa-4f71-8429-e81d22a6a985 {{(pid=84012) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 22 23:48:17 devstack cinder-volume[84012]: INFO cinder.image.image_utils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Converted 1024.00 MB image at 188.60 MB/s
Sep 22 23:48:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d5c46c6b-a6aa-4f71-8429-e81d22a6a985 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:48:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d5c46c6b-a6aa-4f71-8429-e81d22a6a985 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d5c46c6b-a6aa-4f71-8429-e81d22a6a985" returned: 0 in 0.085s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Lock "cinder-quobyte-d5c46c6b-a6aa-4f71-8429-e81d22a6a985" released by "_copy_volume_from_snapshot" :: held 7.221s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:48:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Lock "cinder-quobyte-42ccdee6-5590-42c8-b3eb-919267d8cf99-d5c46c6b-a6aa-4f71-8429-e81d22a6a985" released by "_create_volume_from_snapshot" :: held 7.264s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:48:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.283s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:48:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af2465ad-d7e3-4187-a72d-33800f7a30f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5c46c6b-a6aa-4f71-8429-e81d22a6a985', 'volume_size': 1, 'snapshot_id': '42ccdee6-5590-42c8-b3eb-919267d8cf99'}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043bbafb-9648-470c-a47f-291b0ecc447a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:17 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Volume volume-d5c46c6b-a6aa-4f71-8429-e81d22a6a985 (d5c46c6b-a6aa-4f71-8429-e81d22a6a985): created successfully
Sep 22 23:48:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043bbafb-9648-470c-a47f-291b0ecc447a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Flow 'volume_create_manager' (c4e036ef-3d9d-4cb5-8f6e-a9788370e435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:48:17 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-58fcf41e-c843-429e-a3f5-995cc3b662c8 tempest-SnapshotDependencyTests-1151669366 None] Created volume successfully.
Sep 22 23:48:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] Acquiring lock "cinder-42ccdee6-5590-42c8-b3eb-919267d8cf99-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:48:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] Lock "cinder-42ccdee6-5590-42c8-b3eb-919267d8cf99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:48:18 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:48:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] Acquiring lock "cinder-quobyte-c5ac3391-4476-4a98-be3e-f598dc110879" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:48:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] Lock "cinder-quobyte-c5ac3391-4476-4a98-be3e-f598dc110879" acquired by "delete_snapshot" :: waited 0.012s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:48:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] Acquiring lock "cinder-quobyte-42ccdee6-5590-42c8-b3eb-919267d8cf99" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:48:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] Lock "cinder-quobyte-42ccdee6-5590-42c8-b3eb-919267d8cf99" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:48:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] Deleting offline snapshot 42ccdee6-5590-42c8-b3eb-919267d8cf99 of volume c5ac3391-4476-4a98-be3e-f598dc110879 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:48:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] snapshot_file for this snap is: volume-c5ac3391-4476-4a98-be3e-f598dc110879.42ccdee6-5590-42c8-b3eb-919267d8cf99 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:48:18 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b868254-c422-4bbf-84c7-1a4a030211bc]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:48:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.42ccdee6-5590-42c8-b3eb-919267d8cf99 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.42ccdee6-5590-42c8-b3eb-919267d8cf99" returned: 0 in 0.392s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:18 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5ac3391-4476-4a98-be3e-f598dc110879(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:48:18 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccefbb2a-05c1-4798-b0c1-9e0d8223a60c]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:48:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879" returned: 0 in 0.401s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.42ccdee6-5590-42c8-b3eb-919267d8cf99 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:19 devstack quobyte-client[84065]: System call of process 101243 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:48:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.42ccdee6-5590-42c8-b3eb-919267d8cf99" returned: 0 in 0.231s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.42ccdee6-5590-42c8-b3eb-919267d8cf99 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879.42ccdee6-5590-42c8-b3eb-919267d8cf99" returned: 0 in 0.243s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:19 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] Lock "cinder-quobyte-42ccdee6-5590-42c8-b3eb-919267d8cf99" released by "_delete_snapshot" :: held 1.645s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:48:19 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] Lock "cinder-quobyte-c5ac3391-4476-4a98-be3e-f598dc110879" released by "delete_snapshot" :: held 1.667s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:48:19 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] Created reservations ['05a36055-ac43-4d4a-a094-a7087e80282f', 'b20bac96-c35d-4c55-a32e-dd6088f006b6', 'ab49309e-0bd4-40c2-830e-333fd329c6a9', '23324454-96bc-481f-bb8e-32da7a83dd03'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:48:20 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] Delete snapshot completed successfully.
Sep 22 23:48:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-bd2bec85-d2cf-409a-9ea7-5e00d21eb698 tempest-SnapshotDependencyTests-1151669366 None] Lock "cinder-42ccdee6-5590-42c8-b3eb-919267d8cf99-delete_snapshot" released by "delete_snapshot" :: held 1.991s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:48:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0c34af8e-8522-4dcc-8387-f0688082dff5 tempest-SnapshotDependencyTests-1151669366 None] Acquiring lock "cinder-c5ac3391-4476-4a98-be3e-f598dc110879-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:48:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0c34af8e-8522-4dcc-8387-f0688082dff5 tempest-SnapshotDependencyTests-1151669366 None] Lock "cinder-c5ac3391-4476-4a98-be3e-f598dc110879-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:48:20 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-0c34af8e-8522-4dcc-8387-f0688082dff5 tempest-SnapshotDependencyTests-1151669366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:48:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0c34af8e-8522-4dcc-8387-f0688082dff5 tempest-SnapshotDependencyTests-1151669366 None] Acquiring lock "cinder-quobyte-c5ac3391-4476-4a98-be3e-f598dc110879" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:48:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0c34af8e-8522-4dcc-8387-f0688082dff5 tempest-SnapshotDependencyTests-1151669366 None] Lock "cinder-quobyte-c5ac3391-4476-4a98-be3e-f598dc110879" acquired by "delete_volume" :: waited 0.012s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:48:20 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a653b1-e324-4758-9e99-25856cc53c51]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:48:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0c34af8e-8522-4dcc-8387-f0688082dff5 tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:20 devstack quobyte-client[84065]: System call of process 101247 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:48:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0c34af8e-8522-4dcc-8387-f0688082dff5 tempest-SnapshotDependencyTests-1151669366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879" returned: 0 in 0.406s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0c34af8e-8522-4dcc-8387-f0688082dff5 tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0c34af8e-8522-4dcc-8387-f0688082dff5 tempest-SnapshotDependencyTests-1151669366 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c5ac3391-4476-4a98-be3e-f598dc110879" returned: 0 in 0.109s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:21 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0c34af8e-8522-4dcc-8387-f0688082dff5 tempest-SnapshotDependencyTests-1151669366 None] Lock "cinder-quobyte-c5ac3391-4476-4a98-be3e-f598dc110879" released by "delete_volume" :: held 0.685s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:48:21 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-0c34af8e-8522-4dcc-8387-f0688082dff5 tempest-SnapshotDependencyTests-1151669366 None] Created reservations ['54788859-f621-435d-afcc-ad51fd19c783', 'f53a8d32-ce60-4788-8482-8ef4ea16c329', 'c8d78410-9ce1-49b0-8d6d-75c335a576db', '8fa4545a-b813-484f-9947-9f2fe9f71ebc'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:48:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0c34af8e-8522-4dcc-8387-f0688082dff5 tempest-SnapshotDependencyTests-1151669366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:48:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0c34af8e-8522-4dcc-8387-f0688082dff5 tempest-SnapshotDependencyTests-1151669366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:48:21 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0c34af8e-8522-4dcc-8387-f0688082dff5 tempest-SnapshotDependencyTests-1151669366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:48:21 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0c34af8e-8522-4dcc-8387-f0688082dff5 tempest-SnapshotDependencyTests-1151669366 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:48:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0c34af8e-8522-4dcc-8387-f0688082dff5 tempest-SnapshotDependencyTests-1151669366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:48:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0c34af8e-8522-4dcc-8387-f0688082dff5 tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0c34af8e-8522-4dcc-8387-f0688082dff5 tempest-SnapshotDependencyTests-1151669366 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.099s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:21 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-0c34af8e-8522-4dcc-8387-f0688082dff5 tempest-SnapshotDependencyTests-1151669366 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:48:21 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-0c34af8e-8522-4dcc-8387-f0688082dff5 tempest-SnapshotDependencyTests-1151669366 None] Deleted volume successfully.
Sep 22 23:48:21 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0c34af8e-8522-4dcc-8387-f0688082dff5 tempest-SnapshotDependencyTests-1151669366 None] Lock "cinder-c5ac3391-4476-4a98-be3e-f598dc110879-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:48:22 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-08bc3911-8bb4-429a-ab7b-65330f469066 tempest-SnapshotDependencyTests-1151669366 None] Acquiring lock "cinder-d5c46c6b-a6aa-4f71-8429-e81d22a6a985-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:48:22 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-08bc3911-8bb4-429a-ab7b-65330f469066 tempest-SnapshotDependencyTests-1151669366 None] Lock "cinder-d5c46c6b-a6aa-4f71-8429-e81d22a6a985-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:48:22 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-08bc3911-8bb4-429a-ab7b-65330f469066 tempest-SnapshotDependencyTests-1151669366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:48:22 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-08bc3911-8bb4-429a-ab7b-65330f469066 tempest-SnapshotDependencyTests-1151669366 None] Acquiring lock "cinder-quobyte-d5c46c6b-a6aa-4f71-8429-e81d22a6a985" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:48:22 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-08bc3911-8bb4-429a-ab7b-65330f469066 tempest-SnapshotDependencyTests-1151669366 None] Lock "cinder-quobyte-d5c46c6b-a6aa-4f71-8429-e81d22a6a985" acquired by "delete_volume" :: waited 0.011s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:48:22 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6105ef28-636b-4ea5-89a0-81a6e99311d7]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:48:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08bc3911-8bb4-429a-ab7b-65330f469066 tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d5c46c6b-a6aa-4f71-8429-e81d22a6a985 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08bc3911-8bb4-429a-ab7b-65330f469066 tempest-SnapshotDependencyTests-1151669366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d5c46c6b-a6aa-4f71-8429-e81d22a6a985" returned: 0 in 0.393s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08bc3911-8bb4-429a-ab7b-65330f469066 tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d5c46c6b-a6aa-4f71-8429-e81d22a6a985 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08bc3911-8bb4-429a-ab7b-65330f469066 tempest-SnapshotDependencyTests-1151669366 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-d5c46c6b-a6aa-4f71-8429-e81d22a6a985" returned: 0 in 0.123s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:23 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-08bc3911-8bb4-429a-ab7b-65330f469066 tempest-SnapshotDependencyTests-1151669366 None] Lock "cinder-quobyte-d5c46c6b-a6aa-4f71-8429-e81d22a6a985" released by "delete_volume" :: held 0.677s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:48:23 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-08bc3911-8bb4-429a-ab7b-65330f469066 tempest-SnapshotDependencyTests-1151669366 None] Created reservations ['7208ef9b-298b-4c9a-b993-29171df149fb', 'd636de1f-a351-4a86-b144-8e97bcb85fe0', 'd7f2cd5f-cce6-464b-bcee-0957fa5291cd', 'bd9b9b6a-2667-479f-a0f7-b50530bf854a'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:48:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-08bc3911-8bb4-429a-ab7b-65330f469066 tempest-SnapshotDependencyTests-1151669366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:48:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-08bc3911-8bb4-429a-ab7b-65330f469066 tempest-SnapshotDependencyTests-1151669366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:48:23 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-08bc3911-8bb4-429a-ab7b-65330f469066 tempest-SnapshotDependencyTests-1151669366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:48:23 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-08bc3911-8bb4-429a-ab7b-65330f469066 tempest-SnapshotDependencyTests-1151669366 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:48:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-08bc3911-8bb4-429a-ab7b-65330f469066 tempest-SnapshotDependencyTests-1151669366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:48:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08bc3911-8bb4-429a-ab7b-65330f469066 tempest-SnapshotDependencyTests-1151669366 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08bc3911-8bb4-429a-ab7b-65330f469066 tempest-SnapshotDependencyTests-1151669366 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.106s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:23 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-08bc3911-8bb4-429a-ab7b-65330f469066 tempest-SnapshotDependencyTests-1151669366 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:48:24 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-08bc3911-8bb4-429a-ab7b-65330f469066 tempest-SnapshotDependencyTests-1151669366 None] Deleted volume successfully.
Sep 22 23:48:24 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-08bc3911-8bb4-429a-ab7b-65330f469066 tempest-SnapshotDependencyTests-1151669366 None] Lock "cinder-d5c46c6b-a6aa-4f71-8429-e81d22a6a985-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:48:33 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=22,cinder:UPDATE=36,cinder:DELETE=2,cinder:INSERT=5 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:48:34 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=18,cinder:SELECT=18,cinder:DELETE=3,cinder:INSERT=7 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:48:48 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:48:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:48:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:48:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:48:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:48:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:48:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.229s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:48:54 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Flow 'volume_create_manager' (159295ad-58a3-4f4a-afe2-93cd5037382b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9c64c7-3471-4623-b4a8-de851a857ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9c64c7-3471-4623-b4a8-de851a857ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95cbe9dcd08c4e8fb2da00d7d44e4394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:48:54Z,use_quota=True,user_id='100283ef69444fc1bab6af0115859fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d3b189-ab6b-487e-9e6d-8ebf5afd9e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d3b189-ab6b-487e-9e6d-8ebf5afd9e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b59d0d-ec0f-4685-b7d6-706a9ac5c75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b59d0d-ec0f-4685-b7d6-706a9ac5c75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a', 'volume_name': 'volume-7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01772748-dfa8-4316-9995-8745a30bc97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01772748-dfa8-4316-9995-8745a30bc97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0970a993-4cbb-4d3f-aa17-4aaf4657ae30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:54 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Volume 7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a', 'volume_size': 1}
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95cbe9dcd08c4e8fb2da00d7d44e4394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:48:54Z,use_quota=True,user_id='100283ef69444fc1bab6af0115859fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Creating volume 7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:48:54 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:48:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:54 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=146, name=volume-7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:48:55 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:48:55 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:48:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Flow 'volume_create_manager' (5f31cb48-fe6d-4997-af6f-4cb270cdc75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:48:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f919c2ed-2531-4b8c-9cc1-89456b044737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a 1073741824" returned: 0 in 0.899s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:55 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:48:55 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:48:55 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Flow 'volume_create_manager' (5c868de2-7041-4392-915c-f58f343e6ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983f8d13-f208-4d92-83ca-675afbeecddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f919c2ed-2531-4b8c-9cc1-89456b044737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-227704271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a0912f-a1ae-4d04-9393-3da1a3960d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f948c8d1154827819854ce7a860a46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:48:54Z,use_quota=True,user_id='2023b7515bd0433aacbe6aa60e118095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4b8633-8d00-497d-a297-7ca9b52668eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4b8633-8d00-497d-a297-7ca9b52668eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (851ebdf9-d69a-4565-baa1-2af048c1b711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (851ebdf9-d69a-4565-baa1-2af048c1b711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7a0912f-a1ae-4d04-9393-3da1a3960d3e', 'volume_name': 'volume-c7a0912f-a1ae-4d04-9393-3da1a3960d3e', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b572080-b1a7-4cd3-b8a7-88096e9928c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b572080-b1a7-4cd3-b8a7-88096e9928c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4267a6d-828e-4f77-a941-5494abc53291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:56 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Volume c7a0912f-a1ae-4d04-9393-3da1a3960d3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7a0912f-a1ae-4d04-9393-3da1a3960d3e', 'volume_size': 1}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a" returned: 0 in 0.764s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983f8d13-f208-4d92-83ca-675afbeecddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-325336413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb7c3cc-7305-4f71-8f24-9755178cc3c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f948c8d1154827819854ce7a860a46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:48:55Z,use_quota=True,user_id='2023b7515bd0433aacbe6aa60e118095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ad8f18-481d-4ae6-a7d4-7a1c1eda07a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ad8f18-481d-4ae6-a7d4-7a1c1eda07a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e1b69a-2d3f-41da-8f8d-864c972eb67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e1b69a-2d3f-41da-8f8d-864c972eb67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eb7c3cc-7305-4f71-8f24-9755178cc3c2', 'volume_name': 'volume-8eb7c3cc-7305-4f71-8f24-9755178cc3c2', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071c51c5-7ad1-4f48-9daf-90a3efba1ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071c51c5-7ad1-4f48-9daf-90a3efba1ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50f77ef-5fc8-48a2-a8d6-fabec0572868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:56 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Volume 8eb7c3cc-7305-4f71-8f24-9755178cc3c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eb7c3cc-7305-4f71-8f24-9755178cc3c2', 'volume_size': 1}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] <== create_volume: return (1780ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.158s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-227704271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a0912f-a1ae-4d04-9393-3da1a3960d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f948c8d1154827819854ce7a860a46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:48:54Z,use_quota=True,user_id='2023b7515bd0433aacbe6aa60e118095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Creating volume c7a0912f-a1ae-4d04-9393-3da1a3960d3e {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:48:56 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c7a0912f-a1ae-4d04-9393-3da1a3960d3e 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:56 devstack quobyte-client[84065]: System call of process 101318 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:48:56 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=147, name=volume-c7a0912f-a1ae-4d04-9393-3da1a3960d3e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0970a993-4cbb-4d3f-aa17-4aaf4657ae30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b0a615-45de-4405-b9d8-e8e2511c989d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:56 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:48:56 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Flow 'volume_create_manager' (e478219a-a338-4a84-a5a1-925d1a0b0341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4f2643-8695-4f9d-9215-9612a31ade1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:57 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Volume volume-7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a (7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a): created successfully
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b0a615-45de-4405-b9d8-e8e2511c989d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Flow 'volume_create_manager' (159295ad-58a3-4f4a-afe2-93cd5037382b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c7a0912f-a1ae-4d04-9393-3da1a3960d3e 1073741824" returned: 0 in 0.829s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c7a0912f-a1ae-4d04-9393-3da1a3960d3e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4f2643-8695-4f9d-9215-9612a31ade1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2124667966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c82e12a4-e93e-4711-b886-7ad62fb2f902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f948c8d1154827819854ce7a860a46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:48:55Z,use_quota=True,user_id='2023b7515bd0433aacbe6aa60e118095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bb156e-8d03-4c21-892e-d1485abf8069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bb156e-8d03-4c21-892e-d1485abf8069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (841768b6-d400-461c-b124-8e6e831599cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (841768b6-d400-461c-b124-8e6e831599cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c82e12a4-e93e-4711-b886-7ad62fb2f902', 'volume_name': 'volume-c82e12a4-e93e-4711-b886-7ad62fb2f902', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61399d9c-1fbc-4cab-ac10-47b8262fd136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61399d9c-1fbc-4cab-ac10-47b8262fd136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c057531-ddb1-4f49-abad-6612a4c93d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:57 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Volume c82e12a4-e93e-4711-b886-7ad62fb2f902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c82e12a4-e93e-4711-b886-7ad62fb2f902', 'volume_size': 1}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:48:57 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Flow 'volume_create_manager' (14c488f0-eea3-47c6-b08b-89142b56cf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a759b63-1e5c-4eb2-9828-9cf305ddfb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a759b63-1e5c-4eb2-9828-9cf305ddfb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-589552145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89358ac6-09f4-4ae6-bee8-42fb73da28e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f948c8d1154827819854ce7a860a46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:48:57Z,use_quota=True,user_id='2023b7515bd0433aacbe6aa60e118095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca4c0bf-e111-490e-8bc4-476af47bd421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca4c0bf-e111-490e-8bc4-476af47bd421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9245a4-fbb1-4be7-a8a3-d04f5b537e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9245a4-fbb1-4be7-a8a3-d04f5b537e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89358ac6-09f4-4ae6-bee8-42fb73da28e3', 'volume_name': 'volume-89358ac6-09f4-4ae6-bee8-42fb73da28e3', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b39aa376-6d2c-493a-a665-6a23dea82e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b39aa376-6d2c-493a-a665-6a23dea82e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6d4fc6-69bb-4c37-9605-c6aece7ac2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:57 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Volume 89358ac6-09f4-4ae6-bee8-42fb73da28e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89358ac6-09f4-4ae6-bee8-42fb73da28e3', 'volume_size': 1}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:48:57 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Flow 'volume_create_manager' (a917282d-064d-4177-be4e-3a765b522277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63a1032-b63d-4e93-ab22-4a3af7e37f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:57 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-1b200a0e-a2c8-4b37-8735-ffd2a26ef2bb tempest-CinderUnicodeTest-1926332643 None] Created volume successfully.
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c7a0912f-a1ae-4d04-9393-3da1a3960d3e" returned: 0 in 0.714s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] <== create_volume: return (1595ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.660s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-325336413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb7c3cc-7305-4f71-8f24-9755178cc3c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f948c8d1154827819854ce7a860a46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:48:55Z,use_quota=True,user_id='2023b7515bd0433aacbe6aa60e118095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Creating volume 8eb7c3cc-7305-4f71-8f24-9755178cc3c2 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:48:57 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:48:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8eb7c3cc-7305-4f71-8f24-9755178cc3c2 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:58 devstack quobyte-client[84065]: System call of process 101324 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:48:58 devstack quobyte-client[84065]: System call of process 101324 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:48:58 devstack quobyte-client[84065]: System call of process 101324 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:48:58 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=148, name=volume-8eb7c3cc-7305-4f71-8f24-9755178cc3c2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:48:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63a1032-b63d-4e93-ab22-4a3af7e37f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1135511728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ece65af-d5db-43dc-97ea-2893447c110c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f948c8d1154827819854ce7a860a46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:48:56Z,use_quota=True,user_id='2023b7515bd0433aacbe6aa60e118095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17b2685f-b980-4199-b509-4fd355e3ed5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17b2685f-b980-4199-b509-4fd355e3ed5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57f2505-e1f4-4c6f-aa18-7520b0f31918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57f2505-e1f4-4c6f-aa18-7520b0f31918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ece65af-d5db-43dc-97ea-2893447c110c', 'volume_name': 'volume-5ece65af-d5db-43dc-97ea-2893447c110c', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ccd735-b65a-43a7-b70d-b9d1f1ee6c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ccd735-b65a-43a7-b70d-b9d1f1ee6c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650978f1-0204-4c98-a811-df4553d79cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:58 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Volume 5ece65af-d5db-43dc-97ea-2893447c110c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ece65af-d5db-43dc-97ea-2893447c110c', 'volume_size': 1}
Sep 22 23:48:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:48:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4267a6d-828e-4f77-a941-5494abc53291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7a0912f-a1ae-4d04-9393-3da1a3960d3e', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (710a505d-4ea2-4c95-a650-9e48e1116f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:58 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Volume volume-c7a0912f-a1ae-4d04-9393-3da1a3960d3e (c7a0912f-a1ae-4d04-9393-3da1a3960d3e): created successfully
Sep 22 23:48:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (710a505d-4ea2-4c95-a650-9e48e1116f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Flow 'volume_create_manager' (5f31cb48-fe6d-4997-af6f-4cb270cdc75a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:48:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8eb7c3cc-7305-4f71-8f24-9755178cc3c2 1073741824" returned: 0 in 0.582s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8eb7c3cc-7305-4f71-8f24-9755178cc3c2 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:58 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:48:58 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:48:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Flow 'volume_create_manager' (29de7fe2-413d-4bd2-a571-0d406210d59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:48:58 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7bbd124-6c8d-4d0f-9ae7-f6df64e5c279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:58 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-d77f0fb0-901c-47b5-b5ee-53bc4570c1b5 tempest-CreateVolumesFromImageTest-322535002 None] Created volume successfully.
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7bbd124-6c8d-4d0f-9ae7-f6df64e5c279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2115c16c-4009-4e27-8be2-d09a5bd5a14d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d909c3e8b21a48009ba6ee2cfda36602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:48:58Z,use_quota=True,user_id='f00e77d37e434cd1bbce0b2f017a7918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0374feaf-4fd1-4b32-ad4a-e10840b23b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0374feaf-4fd1-4b32-ad4a-e10840b23b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6824911d-25f0-4a5d-987b-8bdb3760948f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG cinder.image.glance [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Creating Keystone auth plugin from conf {{(pid=84012) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8eb7c3cc-7305-4f71-8f24-9755178cc3c2" returned: 0 in 0.655s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] <== create_volume: return (1282ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.736s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2124667966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c82e12a4-e93e-4711-b886-7ad62fb2f902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f948c8d1154827819854ce7a860a46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:48:55Z,use_quota=True,user_id='2023b7515bd0433aacbe6aa60e118095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Creating volume c82e12a4-e93e-4711-b886-7ad62fb2f902 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:48:59 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c82e12a4-e93e-4711-b886-7ad62fb2f902 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:48:59 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:48:59 devstack quobyte-client[84065]: System call of process 101340 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:48:59 devstack quobyte-client[84065]: System call of process 101340 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:48:59 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=149, name=volume-c82e12a4-e93e-4711-b886-7ad62fb2f902, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Flow 'volume_create_manager' (342bd5f6-d278-4179-b61d-c2dbd380b798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e6873b-d2b7-4264-9b8b-7dabeb8b110e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50f77ef-5fc8-48a2-a8d6-fabec0572868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eb7c3cc-7305-4f71-8f24-9755178cc3c2', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:48:59 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9214651b-0e9f-43fb-ab12-3db3e58688fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c82e12a4-e93e-4711-b886-7ad62fb2f902 1073741824" returned: 0 in 0.809s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c82e12a4-e93e-4711-b886-7ad62fb2f902 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:00 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Volume volume-8eb7c3cc-7305-4f71-8f24-9755178cc3c2 (8eb7c3cc-7305-4f71-8f24-9755178cc3c2): created successfully
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9214651b-0e9f-43fb-ab12-3db3e58688fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Flow 'volume_create_manager' (5c868de2-7041-4392-915c-f58f343e6ecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e6873b-d2b7-4264-9b8b-7dabeb8b110e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:48:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1864357080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95cbe9dcd08c4e8fb2da00d7d44e4394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:48:58Z,use_quota=True,user_id='100283ef69444fc1bab6af0115859fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (348b7805-4f9b-4e2e-8c83-9b09a6388b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (348b7805-4f9b-4e2e-8c83-9b09a6388b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5a9e47-8f63-4c13-9ee3-caf0fbe3b1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5a9e47-8f63-4c13-9ee3-caf0fbe3b1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4', 'volume_name': 'volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6522d3f6-0d92-4898-8f9b-d357f4cc8945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6522d3f6-0d92-4898-8f9b-d357f4cc8945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (702ba27e-c37d-476b-94cd-f5abfae5ab6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:00 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Volume 4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4', 'volume_size': 1}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c82e12a4-e93e-4711-b886-7ad62fb2f902" returned: 0 in 0.617s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] <== create_volume: return (1477ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.921s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-589552145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89358ac6-09f4-4ae6-bee8-42fb73da28e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f948c8d1154827819854ce7a860a46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:48:57Z,use_quota=True,user_id='2023b7515bd0433aacbe6aa60e118095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Creating volume 89358ac6-09f4-4ae6-bee8-42fb73da28e3 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:49:00 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:49:00 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-89358ac6-09f4-4ae6-bee8-42fb73da28e3 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:00 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-f56206b1-7ad0-4dc1-8de3-30cd5d048d1c tempest-CreateVolumesFromImageTest-322535002 None] Created volume successfully.
Sep 22 23:49:00 devstack quobyte-client[84065]: System call of process 101364 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:00 devstack quobyte-client[84065]: System call of process 101364 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:00 devstack quobyte-client[84065]: System call of process 101364 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:00 devstack quobyte-client[84065]: System call of process 101364 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:00 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=150, name=volume-89358ac6-09f4-4ae6-bee8-42fb73da28e3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c057531-ddb1-4f49-abad-6612a4c93d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c82e12a4-e93e-4711-b886-7ad62fb2f902', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06374ab-f6e2-4113-bdc6-fd5f1aa46449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6824911d-25f0-4a5d-987b-8bdb3760948f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2115c16c-4009-4e27-8be2-d09a5bd5a14d', 'volume_name': 'volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d', 'volume_size': 1, 'image_id': 'd4c509ba-61a3-4278-a3a8-238e71597394', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d4c509ba-61a3-4278-a3a8-238e71597394', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c5ec86eeee0bcc16db586ab03af6466', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd909c3e8b21a48009ba6ee2cfda36602', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '569e4eab0ac38a535e3ae83d2ceb1aecd4a303246d69eae4a571b22532761a11ebb56422697f2d2edcddc29cd9d9cecca017e592d732cc0653dd8d629346aea3', 'id': 'd4c509ba-61a3-4278-a3a8-238e71597394', 'created_at': datetime.datetime(2025, 9, 22, 21, 48, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 21, 48, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d4c509ba-61a3-4278-a3a8-238e71597394/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0d0f5626b0>}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9d8b60-aed9-49b1-a3a4-e93840237586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9d8b60-aed9-49b1-a3a4-e93840237586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6ff060-5fc0-4e23-96c7-72c51df4efb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:01 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Volume 2115c16c-4009-4e27-8be2-d09a5bd5a14d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d', 'volume_size': 1, 'image_id': 'd4c509ba-61a3-4278-a3a8-238e71597394', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d4c509ba-61a3-4278-a3a8-238e71597394', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c5ec86eeee0bcc16db586ab03af6466', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd909c3e8b21a48009ba6ee2cfda36602', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '569e4eab0ac38a535e3ae83d2ceb1aecd4a303246d69eae4a571b22532761a11ebb56422697f2d2edcddc29cd9d9cecca017e592d732cc0653dd8d629346aea3', 'id': 'd4c509ba-61a3-4278-a3a8-238e71597394', 'created_at': datetime.datetime(2025, 9, 22, 21, 48, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 21, 48, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d4c509ba-61a3-4278-a3a8-238e71597394/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0d0f5626b0>}
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Cloning 2115c16c-4009-4e27-8be2-d09a5bd5a14d from image d4c509ba-61a3-4278-a3a8-238e71597394  at location (None, [{'url': 'file:///opt/stack/data/glance/images/d4c509ba-61a3-4278-a3a8-238e71597394', 'metadata': {}}]). {{(pid=84012) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-89358ac6-09f4-4ae6-bee8-42fb73da28e3 1073741824" returned: 0 in 0.585s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-89358ac6-09f4-4ae6-bee8-42fb73da28e3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:01 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Volume volume-c82e12a4-e93e-4711-b886-7ad62fb2f902 (c82e12a4-e93e-4711-b886-7ad62fb2f902): created successfully
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06374ab-f6e2-4113-bdc6-fd5f1aa46449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Flow 'volume_create_manager' (e478219a-a338-4a84-a5a1-925d1a0b0341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-89358ac6-09f4-4ae6-bee8-42fb73da28e3" returned: 0 in 0.410s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] <== create_volume: return (1016ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.453s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1135511728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ece65af-d5db-43dc-97ea-2893447c110c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17f948c8d1154827819854ce7a860a46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:48:56Z,use_quota=True,user_id='2023b7515bd0433aacbe6aa60e118095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Creating volume 5ece65af-d5db-43dc-97ea-2893447c110c {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:49:01 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:49:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5ece65af-d5db-43dc-97ea-2893447c110c 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:01 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=151, name=volume-5ece65af-d5db-43dc-97ea-2893447c110c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:49:02 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-63cdfac7-29c5-4334-b959-376727a8d49b tempest-CreateVolumesFromImageTest-322535002 None] Created volume successfully.
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6d4fc6-69bb-4c37-9605-c6aece7ac2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89358ac6-09f4-4ae6-bee8-42fb73da28e3', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7c5c5a-a679-468e-9739-85c20dbe6d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84012) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 22 23:49:02 devstack cinder-volume[84012]: INFO cinder.image.image_utils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Image download 0.00 MB at 0.00 MB/s
Sep 22 23:49:02 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Volume volume-89358ac6-09f4-4ae6-bee8-42fb73da28e3 (89358ac6-09f4-4ae6-bee8-42fb73da28e3): created successfully
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7c5c5a-a679-468e-9739-85c20dbe6d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Flow 'volume_create_manager' (14c488f0-eea3-47c6-b08b-89142b56cf6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5ece65af-d5db-43dc-97ea-2893447c110c 1073741824" returned: 0 in 0.557s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5ece65af-d5db-43dc-97ea-2893447c110c {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:02 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-c0b9c850-bd28-4d1d-95ca-e603fffa18cf tempest-CreateVolumesFromImageTest-322535002 None] Created volume successfully.
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6a93a8-c14e-4ccb-bc52-102a9caa17af]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5ece65af-d5db-43dc-97ea-2893447c110c" returned: 0 in 0.469s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] <== create_volume: return (1079ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.348s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:48:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1864357080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95cbe9dcd08c4e8fb2da00d7d44e4394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:48:58Z,use_quota=True,user_id='100283ef69444fc1bab6af0115859fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Creating volume 4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:49:02 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:49:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:03 devstack quobyte-client[84065]: System call of process 101379 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:03 devstack quobyte-client[84065]: System call of process 101379 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:03 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=152, name=volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:49:03 devstack sudo[101378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD
Sep 22 23:49:03 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:49:03 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650978f1-0204-4c98-a811-df4553d79cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ece65af-d5db-43dc-97ea-2893447c110c', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:03 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d284a61-5c53-4178-bce8-a8957b6246c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:03 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Volume volume-5ece65af-d5db-43dc-97ea-2893447c110c (5ece65af-d5db-43dc-97ea-2893447c110c): created successfully
Sep 22 23:49:03 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d284a61-5c53-4178-bce8-a8957b6246c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:03 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Flow 'volume_create_manager' (a917282d-064d-4177-be4e-3a765b522277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:49:03 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4 1073741824" returned: 0 in 0.544s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:03 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:03 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-c6105992-da19-43aa-87cc-8aaf5760840a tempest-CreateVolumesFromImageTest-322535002 None] Created volume successfully.
Sep 22 23:49:03 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4" returned: 0 in 0.294s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:03 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] <== create_volume: return (877ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:49:03 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:03 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (702ba27e-c37d-476b-94cd-f5abfae5ab6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:04 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebe122a-8abd-4750-a0d2-3da04e4cd9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-f34eefca-2745-4988-a69a-65c554950216 tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "cinder-89358ac6-09f4-4ae6-bee8-42fb73da28e3-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:04 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Volume volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4 (4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4): created successfully
Sep 22 23:49:04 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebe122a-8abd-4750-a0d2-3da04e4cd9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:04 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Flow 'volume_create_manager' (342bd5f6-d278-4179-b61d-c2dbd380b798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:49:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-f34eefca-2745-4988-a69a-65c554950216 tempest-CreateVolumesFromImageTest-322535002 None] Lock "cinder-89358ac6-09f4-4ae6-bee8-42fb73da28e3-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:04 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-d22fbcf4-021f-4f84-8b40-33b7d8e98558 tempest-CinderUnicodeTest-1926332643 None] Created volume successfully.
Sep 22 23:49:04 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-f34eefca-2745-4988-a69a-65c554950216 tempest-CreateVolumesFromImageTest-322535002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-f34eefca-2745-4988-a69a-65c554950216 tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "cinder-quobyte-89358ac6-09f4-4ae6-bee8-42fb73da28e3" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:04 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-f34eefca-2745-4988-a69a-65c554950216 tempest-CreateVolumesFromImageTest-322535002 None] Lock "cinder-quobyte-89358ac6-09f4-4ae6-bee8-42fb73da28e3" acquired by "delete_volume" :: waited 0.022s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:04 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3624bd12-cbd2-4ee8-b0d5-154b6ce68c2c]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:04 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f34eefca-2745-4988-a69a-65c554950216 tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-89358ac6-09f4-4ae6-bee8-42fb73da28e3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f34eefca-2745-4988-a69a-65c554950216 tempest-CreateVolumesFromImageTest-322535002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-89358ac6-09f4-4ae6-bee8-42fb73da28e3" returned: 0 in 0.602s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f34eefca-2745-4988-a69a-65c554950216 tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-89358ac6-09f4-4ae6-bee8-42fb73da28e3 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f34eefca-2745-4988-a69a-65c554950216 tempest-CreateVolumesFromImageTest-322535002 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-89358ac6-09f4-4ae6-bee8-42fb73da28e3" returned: 0 in 0.237s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:05 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-f34eefca-2745-4988-a69a-65c554950216 tempest-CreateVolumesFromImageTest-322535002 None] Lock "cinder-quobyte-89358ac6-09f4-4ae6-bee8-42fb73da28e3" released by "delete_volume" :: held 1.429s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:05 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root
Sep 22 23:49:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD" returned: 0 in 3.211s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:06 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:06 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] Creating offline snapshot 4dcb035c-41ce-43dd-b6b8-517f40a9d437 of volume 4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4 {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:49:06 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4268a2a5-c96e-4d7b-8377-ab504a4132c7]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:06 devstack sudo[101391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD
Sep 22 23:49:06 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:49:06 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-f34eefca-2745-4988-a69a-65c554950216 tempest-CreateVolumesFromImageTest-322535002 None] Created reservations ['b3519b2a-b67e-4a2b-9830-d8cf35eb4904', 'f55ffc4d-6bcc-4402-872f-ff497511e2d9', '22ee5afe-205a-4884-b669-c3ac6bc59c61', '28b53034-8827-4ceb-9ad5-ffdbe433a23b'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:49:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f34eefca-2745-4988-a69a-65c554950216 tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f34eefca-2745-4988-a69a-65c554950216 tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:06 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f34eefca-2745-4988-a69a-65c554950216 tempest-CreateVolumesFromImageTest-322535002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:06 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-f34eefca-2745-4988-a69a-65c554950216 tempest-CreateVolumesFromImageTest-322535002 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-f34eefca-2745-4988-a69a-65c554950216 tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f34eefca-2745-4988-a69a-65c554950216 tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:06 devstack quobyte-client[84065]: System call of process 101392 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4" returned: 0 in 0.748s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.4dcb035c-41ce-43dd-b6b8-517f40a9d437 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-f34eefca-2745-4988-a69a-65c554950216 tempest-CreateVolumesFromImageTest-322535002 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.253s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:07 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-f34eefca-2745-4988-a69a-65c554950216 tempest-CreateVolumesFromImageTest-322535002 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:49:07 devstack quobyte-client[84065]: System call of process 101398 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:07 devstack quobyte-client[84065]: System call of process 101398 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:07 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=153, name=volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.4dcb035c-41ce-43dd-b6b8-517f40a9d437, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:49:07 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-f34eefca-2745-4988-a69a-65c554950216 tempest-CreateVolumesFromImageTest-322535002 None] Deleted volume successfully.
Sep 22 23:49:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.4dcb035c-41ce-43dd-b6b8-517f40a9d437 1G" returned: 0 in 0.462s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.4dcb035c-41ce-43dd-b6b8-517f40a9d437 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:07 devstack quobyte-client[84065]: System call of process 101401 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:07 devstack quobyte-client[84065]: System call of process 101401 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:07 devstack quobyte-client[84065]: System call of process 101401 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:07 devstack quobyte-client[84065]: System call of process 101401 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:08 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-abf568eb-9d1e-4e79-89af-b5feb6b29f55 tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "cinder-5ece65af-d5db-43dc-97ea-2893447c110c-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] CMD "qemu-img rebase -u -b volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.4dcb035c-41ce-43dd-b6b8-517f40a9d437" returned: 0 in 0.486s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:08 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.4dcb035c-41ce-43dd-b6b8-517f40a9d437 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:49:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.4dcb035c-41ce-43dd-b6b8-517f40a9d437 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:08 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-f34eefca-2745-4988-a69a-65c554950216 tempest-CreateVolumesFromImageTest-322535002 None] Lock "cinder-89358ac6-09f4-4ae6-bee8-42fb73da28e3-delete_volume" released by "delete_volume" :: held 4.031s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.4dcb035c-41ce-43dd-b6b8-517f40a9d437" returned: 0 in 0.345s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:08 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4 -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:49:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.4dcb035c-41ce-43dd-b6b8-517f40a9d437 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:08 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-abf568eb-9d1e-4e79-89af-b5feb6b29f55 tempest-CreateVolumesFromImageTest-322535002 None] Lock "cinder-5ece65af-d5db-43dc-97ea-2893447c110c-delete_volume" acquired by "delete_volume" :: waited 0.706s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.4dcb035c-41ce-43dd-b6b8-517f40a9d437" returned: 0 in 0.628s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:09 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root
Sep 22 23:49:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD" returned: 1 in 3.433s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:49:09 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Temporary image d4c509ba-61a3-4278-a3a8-238e71597394 is fetched for user f00e77d37e434cd1bbce0b2f017a7918. {{(pid=84012) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 22 23:49:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.info" returned: 0 in 0.414s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:09 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.info is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:49:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:09 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-abf568eb-9d1e-4e79-89af-b5feb6b29f55 tempest-CreateVolumesFromImageTest-322535002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:09 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-abf568eb-9d1e-4e79-89af-b5feb6b29f55 tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "cinder-quobyte-5ece65af-d5db-43dc-97ea-2893447c110c" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.info" returned: 0 in 0.377s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.891s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:10 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-abf568eb-9d1e-4e79-89af-b5feb6b29f55 tempest-CreateVolumesFromImageTest-322535002 None] Lock "cinder-quobyte-5ece65af-d5db-43dc-97ea-2893447c110c" acquired by "delete_volume" :: waited 0.299s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:10 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-1e7cf565-74ae-468a-8fe6-d118b0d44c34 tempest-CinderUnicodeTest-1926332643 None] Create snapshot completed successfully
Sep 22 23:49:10 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0938e215-e896-4ca6-9f6f-7092200a3597]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:10 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[3734812a-05ff-4e07-b22b-8e38c90c75f2]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-abf568eb-9d1e-4e79-89af-b5feb6b29f55 tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5ece65af-d5db-43dc-97ea-2893447c110c {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:10 devstack sudo[101412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD
Sep 22 23:49:10 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:49:10 devstack quobyte-client[84065]: System call of process 101413 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-abf568eb-9d1e-4e79-89af-b5feb6b29f55 tempest-CreateVolumesFromImageTest-322535002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5ece65af-d5db-43dc-97ea-2893447c110c" returned: 0 in 0.578s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-abf568eb-9d1e-4e79-89af-b5feb6b29f55 tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5ece65af-d5db-43dc-97ea-2893447c110c {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-abf568eb-9d1e-4e79-89af-b5feb6b29f55 tempest-CreateVolumesFromImageTest-322535002 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-5ece65af-d5db-43dc-97ea-2893447c110c" returned: 0 in 0.142s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:11 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] Acquiring lock "cinder-4dcb035c-41ce-43dd-b6b8-517f40a9d437-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:11 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-abf568eb-9d1e-4e79-89af-b5feb6b29f55 tempest-CreateVolumesFromImageTest-322535002 None] Lock "cinder-quobyte-5ece65af-d5db-43dc-97ea-2893447c110c" released by "delete_volume" :: held 1.163s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:11 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] Lock "cinder-4dcb035c-41ce-43dd-b6b8-517f40a9d437-delete_snapshot" acquired by "delete_snapshot" :: waited 0.219s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:11 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:11 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] Acquiring lock "cinder-quobyte-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:11 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] Lock "cinder-quobyte-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4" acquired by "delete_snapshot" :: waited 0.077s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:11 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] Acquiring lock "cinder-quobyte-4dcb035c-41ce-43dd-b6b8-517f40a9d437" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:11 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] Lock "cinder-quobyte-4dcb035c-41ce-43dd-b6b8-517f40a9d437" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:11 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] Deleting offline snapshot 4dcb035c-41ce-43dd-b6b8-517f40a9d437 of volume 4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:49:11 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] snapshot_file for this snap is: volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.4dcb035c-41ce-43dd-b6b8-517f40a9d437 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:49:11 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-abf568eb-9d1e-4e79-89af-b5feb6b29f55 tempest-CreateVolumesFromImageTest-322535002 None] Created reservations ['b15c2fc2-a357-4163-8952-4e19f932d50a', '5a8157e4-c3f5-452d-838c-ba66a03d81f5', '3791e068-cce9-426d-b07c-88fad64d0f2c', 'a61c8eb7-62c3-4f35-b43c-5f4d37c15993'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:49:11 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[281c7347-b2fd-48d0-a698-9ebc691885c6]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.4dcb035c-41ce-43dd-b6b8-517f40a9d437 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-abf568eb-9d1e-4e79-89af-b5feb6b29f55 tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-abf568eb-9d1e-4e79-89af-b5feb6b29f55 tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:12 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-abf568eb-9d1e-4e79-89af-b5feb6b29f55 tempest-CreateVolumesFromImageTest-322535002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:12 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-abf568eb-9d1e-4e79-89af-b5feb6b29f55 tempest-CreateVolumesFromImageTest-322535002 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-abf568eb-9d1e-4e79-89af-b5feb6b29f55 tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-abf568eb-9d1e-4e79-89af-b5feb6b29f55 tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:12 devstack quobyte-client[84065]: System call of process 101418 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ba80e068-74e5-47c9-8343-a25a47701d7b tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "cinder-c82e12a4-e93e-4711-b886-7ad62fb2f902-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.4dcb035c-41ce-43dd-b6b8-517f40a9d437" returned: 0 in 1.202s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:12 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:49:12 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ba80e068-74e5-47c9-8343-a25a47701d7b tempest-CreateVolumesFromImageTest-322535002 None] Lock "cinder-c82e12a4-e93e-4711-b886-7ad62fb2f902-delete_volume" acquired by "delete_volume" :: waited 0.208s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:12 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02b2237-3a39-4594-97c1-ff1efb2ca4dc]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-abf568eb-9d1e-4e79-89af-b5feb6b29f55 tempest-CreateVolumesFromImageTest-322535002 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.808s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:13 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root
Sep 22 23:49:13 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-abf568eb-9d1e-4e79-89af-b5feb6b29f55 tempest-CreateVolumesFromImageTest-322535002 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:49:13 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-abf568eb-9d1e-4e79-89af-b5feb6b29f55 tempest-CreateVolumesFromImageTest-322535002 None] Deleted volume successfully.
Sep 22 23:49:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD" returned: 0 in 3.262s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:13 devstack quobyte-client[84065]: System call of process 101424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:13 devstack quobyte-client[84065]: System call of process 101424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:13 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-abf568eb-9d1e-4e79-89af-b5feb6b29f55 tempest-CreateVolumesFromImageTest-322535002 None] Lock "cinder-5ece65af-d5db-43dc-97ea-2893447c110c-delete_volume" released by "delete_volume" :: held 5.115s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:13 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-ba80e068-74e5-47c9-8343-a25a47701d7b tempest-CreateVolumesFromImageTest-322535002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:13 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ba80e068-74e5-47c9-8343-a25a47701d7b tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "cinder-quobyte-c82e12a4-e93e-4711-b886-7ad62fb2f902" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4" returned: 0 in 0.936s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.4dcb035c-41ce-43dd-b6b8-517f40a9d437 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:14 devstack sudo[101425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD
Sep 22 23:49:14 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 22 23:49:14 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ba80e068-74e5-47c9-8343-a25a47701d7b tempest-CreateVolumesFromImageTest-322535002 None] Lock "cinder-quobyte-c82e12a4-e93e-4711-b886-7ad62fb2f902" acquired by "delete_volume" :: waited 0.267s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:14 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[827b5028-f57c-4908-89ec-6085bf5e9ded]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ba80e068-74e5-47c9-8343-a25a47701d7b tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c82e12a4-e93e-4711-b886-7ad62fb2f902 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.4dcb035c-41ce-43dd-b6b8-517f40a9d437" returned: 0 in 0.398s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.4dcb035c-41ce-43dd-b6b8-517f40a9d437 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4.4dcb035c-41ce-43dd-b6b8-517f40a9d437" returned: 0 in 0.211s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:14 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] Lock "cinder-quobyte-4dcb035c-41ce-43dd-b6b8-517f40a9d437" released by "_delete_snapshot" :: held 3.296s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:14 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] Lock "cinder-quobyte-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4" released by "delete_snapshot" :: held 3.359s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:14 devstack quobyte-client[84065]: System call of process 101432 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:14 devstack quobyte-client[84065]: System call of process 101432 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ba80e068-74e5-47c9-8343-a25a47701d7b tempest-CreateVolumesFromImageTest-322535002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c82e12a4-e93e-4711-b886-7ad62fb2f902" returned: 0 in 0.829s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ba80e068-74e5-47c9-8343-a25a47701d7b tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c82e12a4-e93e-4711-b886-7ad62fb2f902 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ba80e068-74e5-47c9-8343-a25a47701d7b tempest-CreateVolumesFromImageTest-322535002 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c82e12a4-e93e-4711-b886-7ad62fb2f902" returned: 0 in 0.344s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:15 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ba80e068-74e5-47c9-8343-a25a47701d7b tempest-CreateVolumesFromImageTest-322535002 None] Lock "cinder-quobyte-c82e12a4-e93e-4711-b886-7ad62fb2f902" released by "delete_volume" :: held 1.423s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:15 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] Created reservations ['f3acea89-096b-42b9-b830-6b58b4b62fe9', 'f702c8c4-e228-4c1d-ad38-a23bf2f6e7b3', '29b44dc8-a139-4c30-8299-b5531fb68525', 'a68c9ede-1c89-4c2e-bdd8-d1a35bd514fd'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:49:15 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-ba80e068-74e5-47c9-8343-a25a47701d7b tempest-CreateVolumesFromImageTest-322535002 None] Created reservations ['de401aac-2d08-4cec-b1f7-51f4b73d374f', '80642d07-7af2-4f81-88ef-792c4f74ebd5', 'ed48d49a-74e1-4b27-8f9e-aa295ae29d2e', '33b62e42-f571-4c87-a927-753a2dc9a6b1'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:49:15 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] Delete snapshot completed successfully.
Sep 22 23:49:15 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3aa0d3a1-db9b-4d81-aa62-9bf6f38af553 tempest-CinderUnicodeTest-1926332643 None] Lock "cinder-4dcb035c-41ce-43dd-b6b8-517f40a9d437-delete_snapshot" released by "delete_snapshot" :: held 4.528s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ba80e068-74e5-47c9-8343-a25a47701d7b tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ba80e068-74e5-47c9-8343-a25a47701d7b tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:15 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ba80e068-74e5-47c9-8343-a25a47701d7b tempest-CreateVolumesFromImageTest-322535002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-ba80e068-74e5-47c9-8343-a25a47701d7b tempest-CreateVolumesFromImageTest-322535002 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-ba80e068-74e5-47c9-8343-a25a47701d7b tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ba80e068-74e5-47c9-8343-a25a47701d7b tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-ba80e068-74e5-47c9-8343-a25a47701d7b tempest-CreateVolumesFromImageTest-322535002 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.163s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:16 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-ba80e068-74e5-47c9-8343-a25a47701d7b tempest-CreateVolumesFromImageTest-322535002 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:49:16 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-ba80e068-74e5-47c9-8343-a25a47701d7b tempest-CreateVolumesFromImageTest-322535002 None] Deleted volume successfully.
Sep 22 23:49:16 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root
Sep 22 23:49:16 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4332a647-3f72-47c2-a721-de28bc460f48 tempest-CinderUnicodeTest-1926332643 None] Acquiring lock "cinder-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD" returned: 1 in 3.374s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:49:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2115c16c-4009-4e27-8be2-d09a5bd5a14d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d909c3e8b21a48009ba6ee2cfda36602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:48:58Z,use_quota=True,user_id='f00e77d37e434cd1bbce0b2f017a7918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:49:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Creating volume 2115c16c-4009-4e27-8be2-d09a5bd5a14d {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:49:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:49:16 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:49:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:16 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-ba80e068-74e5-47c9-8343-a25a47701d7b tempest-CreateVolumesFromImageTest-322535002 None] Lock "cinder-c82e12a4-e93e-4711-b886-7ad62fb2f902-delete_volume" released by "delete_volume" :: held 4.100s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:16 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=155, name=volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:49:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4332a647-3f72-47c2-a721-de28bc460f48 tempest-CinderUnicodeTest-1926332643 None] Lock "cinder-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4-delete_volume" acquired by "delete_volume" :: waited 0.393s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9ad3b733-7ad0-4ae4-ad81-771bc03ee8fc tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "cinder-8eb7c3cc-7305-4f71-8f24-9755178cc3c2-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d 1073741824" returned: 0 in 0.515s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9ad3b733-7ad0-4ae4-ad81-771bc03ee8fc tempest-CreateVolumesFromImageTest-322535002 None] Lock "cinder-8eb7c3cc-7305-4f71-8f24-9755178cc3c2-delete_volume" acquired by "delete_volume" :: waited 0.408s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d" returned: 0 in 0.426s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] <== create_volume: return (976ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:49:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:17 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-4332a647-3f72-47c2-a721-de28bc460f48 tempest-CinderUnicodeTest-1926332643 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4332a647-3f72-47c2-a721-de28bc460f48 tempest-CinderUnicodeTest-1926332643 None] Acquiring lock "cinder-quobyte-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:17 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-9ad3b733-7ad0-4ae4-ad81-771bc03ee8fc tempest-CreateVolumesFromImageTest-322535002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9ad3b733-7ad0-4ae4-ad81-771bc03ee8fc tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "cinder-quobyte-8eb7c3cc-7305-4f71-8f24-9755178cc3c2" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4332a647-3f72-47c2-a721-de28bc460f48 tempest-CinderUnicodeTest-1926332643 None] Lock "cinder-quobyte-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4" acquired by "delete_volume" :: waited 0.048s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9ad3b733-7ad0-4ae4-ad81-771bc03ee8fc tempest-CreateVolumesFromImageTest-322535002 None] Lock "cinder-quobyte-8eb7c3cc-7305-4f71-8f24-9755178cc3c2" acquired by "delete_volume" :: waited 0.078s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:17 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64df175-16ba-4789-af76-6d953d19d438]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4332a647-3f72-47c2-a721-de28bc460f48 tempest-CinderUnicodeTest-1926332643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:18 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc66295f-1259-4ad6-a087-94ad56abad3f]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9ad3b733-7ad0-4ae4-ad81-771bc03ee8fc tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8eb7c3cc-7305-4f71-8f24-9755178cc3c2 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:18 devstack cinder-volume[84012]: DEBUG cinder.volume.volume_utils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Attempting download of d4c509ba-61a3-4278-a3a8-238e71597394 ((None, [{'url': 'file:///opt/stack/data/glance/images/d4c509ba-61a3-4278-a3a8-238e71597394', 'metadata': {}}])) to volume 2115c16c-4009-4e27-8be2-d09a5bd5a14d. {{(pid=84012) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 22 23:49:18 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[30421e62-be7c-4c34-b441-b957ec0ca971]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d4c509ba-61a3-4278-a3a8-238e71597394_va_ulus9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4332a647-3f72-47c2-a721-de28bc460f48 tempest-CinderUnicodeTest-1926332643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4" returned: 0 in 0.705s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4332a647-3f72-47c2-a721-de28bc460f48 tempest-CinderUnicodeTest-1926332643 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:18 devstack quobyte-client[84065]: System call of process 101447 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9ad3b733-7ad0-4ae4-ad81-771bc03ee8fc tempest-CreateVolumesFromImageTest-322535002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8eb7c3cc-7305-4f71-8f24-9755178cc3c2" returned: 0 in 0.720s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9ad3b733-7ad0-4ae4-ad81-771bc03ee8fc tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8eb7c3cc-7305-4f71-8f24-9755178cc3c2 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4332a647-3f72-47c2-a721-de28bc460f48 tempest-CinderUnicodeTest-1926332643 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4" returned: 0 in 0.225s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9ad3b733-7ad0-4ae4-ad81-771bc03ee8fc tempest-CreateVolumesFromImageTest-322535002 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-8eb7c3cc-7305-4f71-8f24-9755178cc3c2" returned: 0 in 0.228s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:19 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4332a647-3f72-47c2-a721-de28bc460f48 tempest-CinderUnicodeTest-1926332643 None] Lock "cinder-quobyte-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4" released by "delete_volume" :: held 1.263s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:19 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9ad3b733-7ad0-4ae4-ad81-771bc03ee8fc tempest-CreateVolumesFromImageTest-322535002 None] Lock "cinder-quobyte-8eb7c3cc-7305-4f71-8f24-9755178cc3c2" released by "delete_volume" :: held 1.371s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d4c509ba-61a3-4278-a3a8-238e71597394_va_ulus9" returned: 0 in 0.773s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4c509ba-61a3-4278-a3a8-238e71597394_va_ulus9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:19 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-4332a647-3f72-47c2-a721-de28bc460f48 tempest-CinderUnicodeTest-1926332643 None] Created reservations ['60bd213d-a88d-4a70-b58a-8fcdfec04542', 'd87efb38-66cb-4f85-ad5c-66f4cc16915a', '9ca0cdd7-d194-4419-ac6e-506134cdd597', 'f5dcf7c6-6442-43ac-b638-fcfe03d5e0fa'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:49:19 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-9ad3b733-7ad0-4ae4-ad81-771bc03ee8fc tempest-CreateVolumesFromImageTest-322535002 None] Created reservations ['6ccff275-be63-482f-ac40-c9867d0c76e4', '455564a1-b964-4778-b26a-d6536d77c07f', 'fd03918c-fd92-4dfb-9d7c-a0f912ad749d', 'a6beec63-1519-4da9-a2d4-9c7fa47ea5bb'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:49:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4c509ba-61a3-4278-a3a8-238e71597394_va_ulus9" returned: 1 in 0.559s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4c509ba-61a3-4278-a3a8-238e71597394_va_ulus9' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:49:19 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7da1dd-9c33-4af8-95ae-9b9675b924ac]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4332a647-3f72-47c2-a721-de28bc460f48 tempest-CinderUnicodeTest-1926332643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4332a647-3f72-47c2-a721-de28bc460f48 tempest-CinderUnicodeTest-1926332643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-4332a647-3f72-47c2-a721-de28bc460f48 tempest-CinderUnicodeTest-1926332643 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-4332a647-3f72-47c2-a721-de28bc460f48 tempest-CinderUnicodeTest-1926332643 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4332a647-3f72-47c2-a721-de28bc460f48 tempest-CinderUnicodeTest-1926332643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4332a647-3f72-47c2-a721-de28bc460f48 tempest-CinderUnicodeTest-1926332643 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9ad3b733-7ad0-4ae4-ad81-771bc03ee8fc tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9ad3b733-7ad0-4ae4-ad81-771bc03ee8fc tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-9ad3b733-7ad0-4ae4-ad81-771bc03ee8fc tempest-CreateVolumesFromImageTest-322535002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:20 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-9ad3b733-7ad0-4ae4-ad81-771bc03ee8fc tempest-CreateVolumesFromImageTest-322535002 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9ad3b733-7ad0-4ae4-ad81-771bc03ee8fc tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9ad3b733-7ad0-4ae4-ad81-771bc03ee8fc tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:20 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0bc70551-89bc-4b2b-88d2-795ae32951d6 tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "cinder-c7a0912f-a1ae-4d04-9393-3da1a3960d3e-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD" returned: 0 in 1.028s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:20 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:21 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0bc70551-89bc-4b2b-88d2-795ae32951d6 tempest-CreateVolumesFromImageTest-322535002 None] Lock "cinder-c7a0912f-a1ae-4d04-9393-3da1a3960d3e-delete_volume" acquired by "delete_volume" :: waited 0.347s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4332a647-3f72-47c2-a721-de28bc460f48 tempest-CinderUnicodeTest-1926332643 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.921s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:21 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-4332a647-3f72-47c2-a721-de28bc460f48 tempest-CinderUnicodeTest-1926332643 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:49:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9ad3b733-7ad0-4ae4-ad81-771bc03ee8fc tempest-CreateVolumesFromImageTest-322535002 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.850s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:21 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3eb991f4-093b-4b6c-a466-8061ce0af21b tempest-CinderUnicodeTest-1926332643 None] Acquiring lock "cinder-7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:21 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-9ad3b733-7ad0-4ae4-ad81-771bc03ee8fc tempest-CreateVolumesFromImageTest-322535002 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:49:21 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-4332a647-3f72-47c2-a721-de28bc460f48 tempest-CinderUnicodeTest-1926332643 None] Deleted volume successfully.
Sep 22 23:49:21 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-0bc70551-89bc-4b2b-88d2-795ae32951d6 tempest-CreateVolumesFromImageTest-322535002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:21 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0bc70551-89bc-4b2b-88d2-795ae32951d6 tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "cinder-quobyte-c7a0912f-a1ae-4d04-9393-3da1a3960d3e" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD" returned: 1 in 0.696s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:49:21 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] d4c509ba-61a3-4278-a3a8-238e71597394 was raw, converting to raw {{(pid=84012) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 22 23:49:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:21 devstack quobyte-client[84065]: System call of process 101465 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:21 devstack quobyte-client[84065]: System call of process 101465 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:21 devstack quobyte-client[84065]: System call of process 101465 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:21 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=155, name=volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:49:21 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3eb991f4-093b-4b6c-a466-8061ce0af21b tempest-CinderUnicodeTest-1926332643 None] Lock "cinder-7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a-delete_volume" acquired by "delete_volume" :: waited 0.360s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:22 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0bc70551-89bc-4b2b-88d2-795ae32951d6 tempest-CreateVolumesFromImageTest-322535002 None] Lock "cinder-quobyte-c7a0912f-a1ae-4d04-9393-3da1a3960d3e" acquired by "delete_volume" :: waited 0.431s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d" returned: 0 in 0.432s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:22 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d4c509ba-61a3-4278-a3a8-238e71597394_7ww2uu29devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d {{(pid=84012) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 22 23:49:22 devstack cinder-volume[84012]: INFO cinder.image.image_utils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Converted 0.00 MB image at 0.00 MB/s
Sep 22 23:49:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:22 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4332a647-3f72-47c2-a721-de28bc460f48 tempest-CinderUnicodeTest-1926332643 None] Lock "cinder-4aa5817b-8b2f-4a4d-bf4b-8b66b47448d4-delete_volume" released by "delete_volume" :: held 5.217s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:22 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[0977d4be-f1c0-4242-a95b-a618831b0560]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0bc70551-89bc-4b2b-88d2-795ae32951d6 tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c7a0912f-a1ae-4d04-9393-3da1a3960d3e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:22 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-9ad3b733-7ad0-4ae4-ad81-771bc03ee8fc tempest-CreateVolumesFromImageTest-322535002 None] Deleted volume successfully.
Sep 22 23:49:22 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-3eb991f4-093b-4b6c-a466-8061ce0af21b tempest-CinderUnicodeTest-1926332643 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:22 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3eb991f4-093b-4b6c-a466-8061ce0af21b tempest-CinderUnicodeTest-1926332643 None] Acquiring lock "cinder-quobyte-7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:22 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d 1G" returned: 0 in 0.879s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:23 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9ad3b733-7ad0-4ae4-ad81-771bc03ee8fc tempest-CreateVolumesFromImageTest-322535002 None] Lock "cinder-8eb7c3cc-7305-4f71-8f24-9755178cc3c2-delete_volume" released by "delete_volume" :: held 5.349s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:23 devstack quobyte-client[84065]: System call of process 101471 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:23 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3eb991f4-093b-4b6c-a466-8061ce0af21b tempest-CinderUnicodeTest-1926332643 None] Lock "cinder-quobyte-7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a" acquired by "delete_volume" :: waited 0.149s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:23 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[116cf2f9-bf16-44a0-8527-b73f48cc718c]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:23 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[720f58b1-aa87-453b-8d8a-78692759a999]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3eb991f4-093b-4b6c-a466-8061ce0af21b tempest-CinderUnicodeTest-1926332643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0bc70551-89bc-4b2b-88d2-795ae32951d6 tempest-CreateVolumesFromImageTest-322535002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c7a0912f-a1ae-4d04-9393-3da1a3960d3e" returned: 0 in 0.884s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0bc70551-89bc-4b2b-88d2-795ae32951d6 tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c7a0912f-a1ae-4d04-9393-3da1a3960d3e {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0bc70551-89bc-4b2b-88d2-795ae32951d6 tempest-CreateVolumesFromImageTest-322535002 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-c7a0912f-a1ae-4d04-9393-3da1a3960d3e" returned: 0 in 0.255s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:23 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0bc70551-89bc-4b2b-88d2-795ae32951d6 tempest-CreateVolumesFromImageTest-322535002 None] Lock "cinder-quobyte-c7a0912f-a1ae-4d04-9393-3da1a3960d3e" released by "delete_volume" :: held 1.735s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:23 devstack quobyte-client[84065]: System call of process 101474 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:23 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d" returned: 0 in 0.885s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3eb991f4-093b-4b6c-a466-8061ce0af21b tempest-CinderUnicodeTest-1926332643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a" returned: 0 in 0.847s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3eb991f4-093b-4b6c-a466-8061ce0af21b tempest-CinderUnicodeTest-1926332643 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3eb991f4-093b-4b6c-a466-8061ce0af21b tempest-CinderUnicodeTest-1926332643 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a" returned: 0 in 0.381s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d" returned: 1 in 0.732s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:49:24 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3eb991f4-093b-4b6c-a466-8061ce0af21b tempest-CinderUnicodeTest-1926332643 None] Lock "cinder-quobyte-7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a" released by "delete_volume" :: held 1.700s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:24 devstack cinder-volume[84012]: DEBUG cinder.volume.volume_utils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Downloaded image d4c509ba-61a3-4278-a3a8-238e71597394 ((None, [{'url': 'file:///opt/stack/data/glance/images/d4c509ba-61a3-4278-a3a8-238e71597394', 'metadata': {}}])) to volume 2115c16c-4009-4e27-8be2-d09a5bd5a14d successfully. {{(pid=84012) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 22 23:49:24 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Temporary image d4c509ba-61a3-4278-a3a8-238e71597394 for user f00e77d37e434cd1bbce0b2f017a7918 is deleted. {{(pid=84012) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 22 23:49:24 devstack cinder-volume[84012]: DEBUG cinder.volume.volume_utils [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Marking volume 2115c16c-4009-4e27-8be2-d09a5bd5a14d as bootable. {{(pid=84012) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 22 23:49:24 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-0bc70551-89bc-4b2b-88d2-795ae32951d6 tempest-CreateVolumesFromImageTest-322535002 None] Created reservations ['a60e7c57-67f1-491b-9c05-381bad3dc19a', 'cbde972c-1acc-4a42-858b-31a057f225d3', 'f97669f2-9704-439a-98f3-c445b19a20ca', 'fb7c3e88-72c8-46eb-9cb7-ab2bb6d33345'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:49:24 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Copying metadata from image d4c509ba-61a3-4278-a3a8-238e71597394 to 2115c16c-4009-4e27-8be2-d09a5bd5a14d. {{(pid=84012) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 22 23:49:24 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Creating volume glance metadata for volume 2115c16c-4009-4e27-8be2-d09a5bd5a14d backed by image d4c509ba-61a3-4278-a3a8-238e71597394 with: {'image_id': 'd4c509ba-61a3-4278-a3a8-238e71597394', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2c5ec86eeee0bcc16db586ab03af6466', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84012) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 22 23:49:25 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-3eb991f4-093b-4b6c-a466-8061ce0af21b tempest-CinderUnicodeTest-1926332643 None] Created reservations ['9322b825-3c97-43fb-a5df-fa359204139a', '826c062b-26f7-4d19-83ea-b2f9b03d5076', '750fe025-03db-4bbe-88f7-849b3d02afd3', '9daa1e2c-722e-4035-a3d6-1f5d45ece5e6'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:49:25 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6ff060-5fc0-4e23-96c7-72c51df4efb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d', 'volume_size': 1, 'image_id': 'd4c509ba-61a3-4278-a3a8-238e71597394', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d4c509ba-61a3-4278-a3a8-238e71597394', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c5ec86eeee0bcc16db586ab03af6466', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd909c3e8b21a48009ba6ee2cfda36602', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '569e4eab0ac38a535e3ae83d2ceb1aecd4a303246d69eae4a571b22532761a11ebb56422697f2d2edcddc29cd9d9cecca017e592d732cc0653dd8d629346aea3', 'id': 'd4c509ba-61a3-4278-a3a8-238e71597394', 'created_at': datetime.datetime(2025, 9, 22, 21, 48, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 21, 48, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d4c509ba-61a3-4278-a3a8-238e71597394/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0d0f5626b0>}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:25 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bcaa4f8-ed28-40a8-8241-b911d71efbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:25 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Volume volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d (2115c16c-4009-4e27-8be2-d09a5bd5a14d): created successfully
Sep 22 23:49:25 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bcaa4f8-ed28-40a8-8241-b911d71efbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:25 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Flow 'volume_create_manager' (29de7fe2-413d-4bd2-a571-0d406210d59e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:49:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0bc70551-89bc-4b2b-88d2-795ae32951d6 tempest-CreateVolumesFromImageTest-322535002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0bc70551-89bc-4b2b-88d2-795ae32951d6 tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:25 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0bc70551-89bc-4b2b-88d2-795ae32951d6 tempest-CreateVolumesFromImageTest-322535002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:25 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0bc70551-89bc-4b2b-88d2-795ae32951d6 tempest-CreateVolumesFromImageTest-322535002 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0bc70551-89bc-4b2b-88d2-795ae32951d6 tempest-CreateVolumesFromImageTest-322535002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0bc70551-89bc-4b2b-88d2-795ae32951d6 tempest-CreateVolumesFromImageTest-322535002 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:25 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-17d564a9-cfa9-4d31-a5f5-3c3961d61e87 tempest-VolumeImageDependencyTests-849962875 None] Created volume successfully.
Sep 22 23:49:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0bc70551-89bc-4b2b-88d2-795ae32951d6 tempest-CreateVolumesFromImageTest-322535002 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.401s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:25 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-0bc70551-89bc-4b2b-88d2-795ae32951d6 tempest-CreateVolumesFromImageTest-322535002 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:49:25 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-0bc70551-89bc-4b2b-88d2-795ae32951d6 tempest-CreateVolumesFromImageTest-322535002 None] Deleted volume successfully.
Sep 22 23:49:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3eb991f4-093b-4b6c-a466-8061ce0af21b tempest-CinderUnicodeTest-1926332643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3eb991f4-093b-4b6c-a466-8061ce0af21b tempest-CinderUnicodeTest-1926332643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:25 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3eb991f4-093b-4b6c-a466-8061ce0af21b tempest-CinderUnicodeTest-1926332643 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:25 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3eb991f4-093b-4b6c-a466-8061ce0af21b tempest-CinderUnicodeTest-1926332643 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3eb991f4-093b-4b6c-a466-8061ce0af21b tempest-CinderUnicodeTest-1926332643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3eb991f4-093b-4b6c-a466-8061ce0af21b tempest-CinderUnicodeTest-1926332643 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:26 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0bc70551-89bc-4b2b-88d2-795ae32951d6 tempest-CreateVolumesFromImageTest-322535002 None] Lock "cinder-c7a0912f-a1ae-4d04-9393-3da1a3960d3e-delete_volume" released by "delete_volume" :: held 4.963s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:26 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] Acquiring lock "cinder-2115c16c-4009-4e27-8be2-d09a5bd5a14d-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3eb991f4-093b-4b6c-a466-8061ce0af21b tempest-CinderUnicodeTest-1926332643 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.547s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:26 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-3eb991f4-093b-4b6c-a466-8061ce0af21b tempest-CinderUnicodeTest-1926332643 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:49:26 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-3eb991f4-093b-4b6c-a466-8061ce0af21b tempest-CinderUnicodeTest-1926332643 None] Deleted volume successfully.
Sep 22 23:49:26 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] Lock "cinder-2115c16c-4009-4e27-8be2-d09a5bd5a14d-delete_volume" acquired by "delete_volume" :: waited 0.280s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:26 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3eb991f4-093b-4b6c-a466-8061ce0af21b tempest-CinderUnicodeTest-1926332643 None] Lock "cinder-7b7c4af9-8c9c-47aa-85c4-d2ec4b1ea56a-delete_volume" released by "delete_volume" :: held 4.936s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:27 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:27 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] Acquiring lock "cinder-quobyte-2115c16c-4009-4e27-8be2-d09a5bd5a14d" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:27 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] Lock "cinder-quobyte-2115c16c-4009-4e27-8be2-d09a5bd5a14d" acquired by "delete_volume" :: waited 0.013s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:27 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[672ad9e6-db5c-41f2-bafc-4488095e9d28]: (4, 'raw') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d" returned: 0 in 0.586s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:28 devstack quobyte-client[84065]: System call of process 101492 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:28 devstack quobyte-client[84065]: System call of process 101492 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d" returned: 1 in 0.462s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d' failed. Not Retrying. {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 22 23:49:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2115c16c-4009-4e27-8be2-d09a5bd5a14d" returned: 0 in 0.128s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:28 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] Lock "cinder-quobyte-2115c16c-4009-4e27-8be2-d09a5bd5a14d" released by "delete_volume" :: held 1.604s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:29 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] Created reservations ['601768bf-f092-4bb8-91db-fdd6891293e6', '4c9a2a01-1543-49e6-957b-e2f0695ed1f6', '578c739e-4573-4da1-b96e-8a4aec01af0c', '8d68f9ed-e5f7-4026-9639-5537201a4f0d'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:49:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:29 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.137s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:29 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:49:29 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] Deleted volume successfully.
Sep 22 23:49:30 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-db4d268b-60d6-4061-b8b0-065e99a1879a tempest-VolumeImageDependencyTests-849962875 None] Lock "cinder-2115c16c-4009-4e27-8be2-d09a5bd5a14d-delete_volume" released by "delete_volume" :: held 3.358s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:30 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Flow 'volume_create_manager' (2fbfa33a-fc5f-44e7-ae56-6ab73e624b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4b550f-cd5c-4ca1-a0eb-7cb58a381c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4b550f-cd5c-4ca1-a0eb-7cb58a381c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1409317256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a90f22-3660-4a7d-b563-b4035d7c00e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f662486e209a42d4b479e2e234b7e131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:49:31Z,use_quota=True,user_id='0e32938bae6b431e862a72ec6640cdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64ccf36-8095-46d1-9a03-3f87e9abf1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64ccf36-8095-46d1-9a03-3f87e9abf1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13f2ed2-2a89-47e0-b7a1-c7fa287fec69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13f2ed2-2a89-47e0-b7a1-c7fa287fec69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0a90f22-3660-4a7d-b563-b4035d7c00e9', 'volume_name': 'volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd5a9fa-fa02-49b9-8213-3e771e07d549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd5a9fa-fa02-49b9-8213-3e771e07d549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb627f47-1cb3-4d91-9cef-5c46254bea2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:31 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume a0a90f22-3660-4a7d-b563-b4035d7c00e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9', 'volume_size': 1}
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1409317256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a90f22-3660-4a7d-b563-b4035d7c00e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f662486e209a42d4b479e2e234b7e131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:49:31Z,use_quota=True,user_id='0e32938bae6b431e862a72ec6640cdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Creating volume a0a90f22-3660-4a7d-b563-b4035d7c00e9 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:49:31 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:31 devstack quobyte-client[84065]: System call of process 101497 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:31 devstack quobyte-client[84065]: System call of process 101497 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:31 devstack quobyte-client[84065]: System call of process 101497 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:31 devstack quobyte-client[84065]: System call of process 101497 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:31 devstack quobyte-client[84065]: System call of process 101497 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:31 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=156, name=volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9 1073741824" returned: 0 in 0.552s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9" returned: 0 in 0.151s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:32 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] <== create_volume: return (818ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:49:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb627f47-1cb3-4d91-9cef-5c46254bea2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c58181-b39e-45d7-ad5b-536a6f07810b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:32 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9 (a0a90f22-3660-4a7d-b563-b4035d7c00e9): created successfully
Sep 22 23:49:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c58181-b39e-45d7-ad5b-536a6f07810b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:32 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Flow 'volume_create_manager' (2fbfa33a-fc5f-44e7-ae56-6ab73e624b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:49:32 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-64f283ab-4af1-4e48-8bde-8f2358adf8f9 tempest-CreateVolumesFromSnapshotTest-875283642 None] Created volume successfully.
Sep 22 23:49:33 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:33 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] Creating offline snapshot 7e43f002-3b97-413f-a550-c6d4e6032a81 of volume a0a90f22-3660-4a7d-b563-b4035d7c00e9 {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:49:33 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac69f9b0-e02f-4087-9f6d-61d8420bade9]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9" returned: 0 in 0.551s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.7e43f002-3b97-413f-a550-c6d4e6032a81 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:34 devstack quobyte-client[84065]: System call of process 101504 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:34 devstack quobyte-client[84065]: System call of process 101504 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:34 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=157, name=volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.7e43f002-3b97-413f-a550-c6d4e6032a81, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:49:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.7e43f002-3b97-413f-a550-c6d4e6032a81 1G" returned: 0 in 0.355s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.7e43f002-3b97-413f-a550-c6d4e6032a81 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:34 devstack quobyte-client[84065]: System call of process 101507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "qemu-img rebase -u -b volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.7e43f002-3b97-413f-a550-c6d4e6032a81" returned: 0 in 0.225s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:34 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.7e43f002-3b97-413f-a550-c6d4e6032a81 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:49:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.7e43f002-3b97-413f-a550-c6d4e6032a81 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.7e43f002-3b97-413f-a550-c6d4e6032a81" returned: 0 in 0.128s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9 -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:49:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.7e43f002-3b97-413f-a550-c6d4e6032a81 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.7e43f002-3b97-413f-a550-c6d4e6032a81" returned: 0 in 0.119s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.info" returned: 0 in 0.117s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.info is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:49:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.info" returned: 0 in 0.131s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.151s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:35 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-bebe31d3-469a-4402-b3be-a16b109daee8 tempest-CreateVolumesFromSnapshotTest-875283642 None] Create snapshot completed successfully
Sep 22 23:49:37 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Flow 'volume_create_manager' (9107fef0-0d5a-463a-8021-d98bfa8abddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aca5a96-be41-4a41-a487-5fe5967059fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aca5a96-be41-4a41-a487-5fe5967059fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-9935749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f662486e209a42d4b479e2e234b7e131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:49:37Z,use_quota=True,user_id='0e32938bae6b431e862a72ec6640cdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b562b35-e7a2-46a0-b9df-d7339b1313e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b562b35-e7a2-46a0-b9df-d7339b1313e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0247f900-f095-425d-9cef-edbeb79f3e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0247f900-f095-425d-9cef-edbeb79f3e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65', 'volume_name': 'volume-a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3494794b-0f70-4800-97f4-d4513b529a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3494794b-0f70-4800-97f4-d4513b529a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615a959b-1983-473e-932e-91bdb306a6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:37 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65', 'volume_size': 1}
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-9935749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f662486e209a42d4b479e2e234b7e131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:49:37Z,use_quota=True,user_id='0e32938bae6b431e862a72ec6640cdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Creating volume a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:49:37 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:49:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:37 devstack quobyte-client[84065]: System call of process 101515 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:37 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=159, name=volume-a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:49:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65 1073741824" returned: 0 in 0.763s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:38 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:38 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Flow 'volume_create_manager' (a2aba209-efb4-4e78-90c2-1da4824fd4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7534a14-2917-48d6-b2d7-68010a1ae465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7534a14-2917-48d6-b2d7-68010a1ae465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-721354413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aeccf33-675f-4579-9ad6-7973336861de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f662486e209a42d4b479e2e234b7e131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:49:38Z,use_quota=True,user_id='0e32938bae6b431e862a72ec6640cdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41fda67-0c54-4b99-a3e4-98e6675e14ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41fda67-0c54-4b99-a3e4-98e6675e14ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69797a00-2023-4747-9b9d-52ebadb60709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69797a00-2023-4747-9b9d-52ebadb60709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aeccf33-675f-4579-9ad6-7973336861de', 'volume_name': 'volume-7aeccf33-675f-4579-9ad6-7973336861de', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da43911e-a586-4392-8752-ea671f53fdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da43911e-a586-4392-8752-ea671f53fdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29675910-95fc-4218-b2b3-18333e26f535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:39 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume 7aeccf33-675f-4579-9ad6-7973336861de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aeccf33-675f-4579-9ad6-7973336861de', 'volume_size': 1}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65" returned: 0 in 1.144s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] <== create_volume: return (1985ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.109s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-721354413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aeccf33-675f-4579-9ad6-7973336861de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f662486e209a42d4b479e2e234b7e131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:49:38Z,use_quota=True,user_id='0e32938bae6b431e862a72ec6640cdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Creating volume 7aeccf33-675f-4579-9ad6-7973336861de {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:49:39 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:49:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7aeccf33-675f-4579-9ad6-7973336861de 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:39 devstack quobyte-client[84065]: System call of process 101519 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:39 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=160, name=volume-7aeccf33-675f-4579-9ad6-7973336861de, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:49:40 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Flow 'volume_create_manager' (8c376b11-b377-4723-a59a-7015be6fe33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b898890-478d-43b7-8ffd-ca58f077b61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b898890-478d-43b7-8ffd-ca58f077b61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-782598715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=792537f7-4dde-41bc-9946-22dc00baea70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f662486e209a42d4b479e2e234b7e131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:49:39Z,use_quota=True,user_id='0e32938bae6b431e862a72ec6640cdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a703da1-c667-4c27-b045-805bf0cf997e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a703da1-c667-4c27-b045-805bf0cf997e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e78130b-0645-45fb-8bd7-fff31e7a2f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e78130b-0645-45fb-8bd7-fff31e7a2f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '792537f7-4dde-41bc-9946-22dc00baea70', 'volume_name': 'volume-792537f7-4dde-41bc-9946-22dc00baea70', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599b813b-1232-43ec-82a1-69105428b303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599b813b-1232-43ec-82a1-69105428b303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b667e8e-4932-4ab6-86f6-eddab5d84edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:40 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume 792537f7-4dde-41bc-9946-22dc00baea70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-792537f7-4dde-41bc-9946-22dc00baea70', 'volume_size': 1}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615a959b-1983-473e-932e-91bdb306a6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829b0683-32d6-4493-bb58-eb541c55a459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:40 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Flow 'volume_create_manager' (8da7f6c9-e684-4ab3-abf1-b36f85d841eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cec26e9-8373-41ac-a645-31bc49cab0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:40 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume volume-a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65 (a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65): created successfully
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829b0683-32d6-4493-bb58-eb541c55a459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Flow 'volume_create_manager' (9107fef0-0d5a-463a-8021-d98bfa8abddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7aeccf33-675f-4579-9ad6-7973336861de 1073741824" returned: 0 in 0.868s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7aeccf33-675f-4579-9ad6-7973336861de {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cec26e9-8373-41ac-a645-31bc49cab0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1045393026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf56306-e5ff-42c5-80a1-c78d4b894ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f662486e209a42d4b479e2e234b7e131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:49:38Z,use_quota=True,user_id='0e32938bae6b431e862a72ec6640cdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b480ca43-c581-45e3-a69f-ac1113c1e951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b480ca43-c581-45e3-a69f-ac1113c1e951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f90c65-3290-485f-9c7e-4a6a7e98d700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f90c65-3290-485f-9c7e-4a6a7e98d700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caf56306-e5ff-42c5-80a1-c78d4b894ad7', 'volume_name': 'volume-caf56306-e5ff-42c5-80a1-c78d4b894ad7', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42611d7f-8520-425d-bd24-747a706a8bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42611d7f-8520-425d-bd24-747a706a8bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adfaaf11-556d-46f2-8b39-871277f47d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:40 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume caf56306-e5ff-42c5-80a1-c78d4b894ad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caf56306-e5ff-42c5-80a1-c78d4b894ad7', 'volume_size': 1}
Sep 22 23:49:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:40 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-5056feb3-4828-41ea-a2c6-b18bbe57d148 tempest-CreateVolumesFromSnapshotTest-875283642 None] Created volume successfully.
Sep 22 23:49:41 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Flow 'volume_create_manager' (4e869df1-232e-4c9b-b9b9-221a951bebc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f6de44-c017-40ee-a521-fa1fe48ca11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f6de44-c017-40ee-a521-fa1fe48ca11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1466130779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1dd5ef5-dd30-43ad-8d87-eb19040d6e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f662486e209a42d4b479e2e234b7e131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:49:40Z,use_quota=True,user_id='0e32938bae6b431e862a72ec6640cdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa26118e-b6f8-4de2-9dc5-578347be1453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa26118e-b6f8-4de2-9dc5-578347be1453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63336ac0-5760-4cbb-918a-3cb4197ec23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63336ac0-5760-4cbb-918a-3cb4197ec23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1dd5ef5-dd30-43ad-8d87-eb19040d6e08', 'volume_name': 'volume-f1dd5ef5-dd30-43ad-8d87-eb19040d6e08', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be7669c-0680-4431-bac4-9567b6dba3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be7669c-0680-4431-bac4-9567b6dba3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427f16f0-0323-4cfa-9ba4-c314307e3a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:41 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume f1dd5ef5-dd30-43ad-8d87-eb19040d6e08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1dd5ef5-dd30-43ad-8d87-eb19040d6e08', 'volume_size': 1}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7aeccf33-675f-4579-9ad6-7973336861de" returned: 0 in 0.723s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] <== create_volume: return (1625ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.834s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-782598715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=792537f7-4dde-41bc-9946-22dc00baea70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f662486e209a42d4b479e2e234b7e131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:49:39Z,use_quota=True,user_id='0e32938bae6b431e862a72ec6640cdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Creating volume 792537f7-4dde-41bc-9946-22dc00baea70 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:49:41 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-792537f7-4dde-41bc-9946-22dc00baea70 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:41 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=161, name=volume-792537f7-4dde-41bc-9946-22dc00baea70, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29675910-95fc-4218-b2b3-18333e26f535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aeccf33-675f-4579-9ad6-7973336861de', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d59165b-58de-4ad5-8887-619a9c23b132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-792537f7-4dde-41bc-9946-22dc00baea70 1073741824" returned: 0 in 0.534s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-792537f7-4dde-41bc-9946-22dc00baea70 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-792537f7-4dde-41bc-9946-22dc00baea70" returned: 0 in 0.177s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] <== create_volume: return (761ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:49:41 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.148s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1045393026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf56306-e5ff-42c5-80a1-c78d4b894ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f662486e209a42d4b479e2e234b7e131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:49:38Z,use_quota=True,user_id='0e32938bae6b431e862a72ec6640cdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:49:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Creating volume caf56306-e5ff-42c5-80a1-c78d4b894ad7 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:49:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:42 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:49:42 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:49:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-caf56306-e5ff-42c5-80a1-c78d4b894ad7 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:42 devstack quobyte-client[84065]: System call of process 101527 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:42 devstack quobyte-client[84065]: System call of process 101527 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:42 devstack quobyte-client[84065]: System call of process 101527 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:42 devstack quobyte-client[84065]: System call of process 101527 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:42 devstack quobyte-client[84065]: System call of process 101527 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:42 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=162, name=volume-caf56306-e5ff-42c5-80a1-c78d4b894ad7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:49:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b667e8e-4932-4ab6-86f6-eddab5d84edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-792537f7-4dde-41bc-9946-22dc00baea70', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b03e56-71a0-41a5-99f2-dfa621304a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:42 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume volume-7aeccf33-675f-4579-9ad6-7973336861de (7aeccf33-675f-4579-9ad6-7973336861de): created successfully
Sep 22 23:49:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d59165b-58de-4ad5-8887-619a9c23b132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Flow 'volume_create_manager' (a2aba209-efb4-4e78-90c2-1da4824fd4fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:49:42 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume volume-792537f7-4dde-41bc-9946-22dc00baea70 (792537f7-4dde-41bc-9946-22dc00baea70): created successfully
Sep 22 23:49:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b03e56-71a0-41a5-99f2-dfa621304a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:42 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Flow 'volume_create_manager' (8c376b11-b377-4723-a59a-7015be6fe33a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:49:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-caf56306-e5ff-42c5-80a1-c78d4b894ad7 1073741824" returned: 0 in 0.614s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:42 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-caf56306-e5ff-42c5-80a1-c78d4b894ad7 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:42 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-28254ca1-1cf4-4f29-b531-f3fe1b59d94f tempest-CreateVolumesFromSnapshotTest-875283642 None] Created volume successfully.
Sep 22 23:49:43 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-e63aec1b-ee4a-4519-8c39-0a58347bd31f tempest-CreateVolumesFromSnapshotTest-875283642 None] Created volume successfully.
Sep 22 23:49:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-caf56306-e5ff-42c5-80a1-c78d4b894ad7" returned: 0 in 0.307s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] <== create_volume: return (962ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:49:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.934s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1466130779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1dd5ef5-dd30-43ad-8d87-eb19040d6e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f662486e209a42d4b479e2e234b7e131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:49:40Z,use_quota=True,user_id='0e32938bae6b431e862a72ec6640cdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:49:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Creating volume f1dd5ef5-dd30-43ad-8d87-eb19040d6e08 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:49:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:49:43 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:49:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f1dd5ef5-dd30-43ad-8d87-eb19040d6e08 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:43 devstack quobyte-client[84065]: System call of process 101531 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:43 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=163, name=volume-f1dd5ef5-dd30-43ad-8d87-eb19040d6e08, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:49:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adfaaf11-556d-46f2-8b39-871277f47d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caf56306-e5ff-42c5-80a1-c78d4b894ad7', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:43 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (075c0ca9-92db-480e-9855-8e4edeb884b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f1dd5ef5-dd30-43ad-8d87-eb19040d6e08 1073741824" returned: 0 in 0.538s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f1dd5ef5-dd30-43ad-8d87-eb19040d6e08 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f1dd5ef5-dd30-43ad-8d87-eb19040d6e08" returned: 0 in 0.177s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:43 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] <== create_volume: return (786ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:49:43 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:44 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume volume-caf56306-e5ff-42c5-80a1-c78d4b894ad7 (caf56306-e5ff-42c5-80a1-c78d4b894ad7): created successfully
Sep 22 23:49:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (075c0ca9-92db-480e-9855-8e4edeb884b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Flow 'volume_create_manager' (8da7f6c9-e684-4ab3-abf1-b36f85d841eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:49:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427f16f0-0323-4cfa-9ba4-c314307e3a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1dd5ef5-dd30-43ad-8d87-eb19040d6e08', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fcbf2f-9676-42e1-be2c-923dd8df3c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:49:44 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-6ba72330-1c10-4399-b474-8ffafbb1996a tempest-CreateVolumesFromSnapshotTest-875283642 None] Created volume successfully.
Sep 22 23:49:44 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume volume-f1dd5ef5-dd30-43ad-8d87-eb19040d6e08 (f1dd5ef5-dd30-43ad-8d87-eb19040d6e08): created successfully
Sep 22 23:49:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fcbf2f-9676-42e1-be2c-923dd8df3c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:49:44 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Flow 'volume_create_manager' (4e869df1-232e-4c9b-b9b9-221a951bebc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:49:44 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-c612b5ae-e6d5-4347-812d-85a00b826568 tempest-CreateVolumesFromSnapshotTest-875283642 None] Created volume successfully.
Sep 22 23:49:44 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4ac6668a-36f6-4c92-a5de-67cc81340331 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "cinder-f1dd5ef5-dd30-43ad-8d87-eb19040d6e08-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:44 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4ac6668a-36f6-4c92-a5de-67cc81340331 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-f1dd5ef5-dd30-43ad-8d87-eb19040d6e08-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:44 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-4ac6668a-36f6-4c92-a5de-67cc81340331 tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:44 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4ac6668a-36f6-4c92-a5de-67cc81340331 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "cinder-quobyte-f1dd5ef5-dd30-43ad-8d87-eb19040d6e08" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:45 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4ac6668a-36f6-4c92-a5de-67cc81340331 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-quobyte-f1dd5ef5-dd30-43ad-8d87-eb19040d6e08" acquired by "delete_volume" :: waited 0.013s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:45 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c163b9-2966-4a1e-8c26-6853c52fa5a8]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4ac6668a-36f6-4c92-a5de-67cc81340331 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f1dd5ef5-dd30-43ad-8d87-eb19040d6e08 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4ac6668a-36f6-4c92-a5de-67cc81340331 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f1dd5ef5-dd30-43ad-8d87-eb19040d6e08" returned: 0 in 0.515s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4ac6668a-36f6-4c92-a5de-67cc81340331 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f1dd5ef5-dd30-43ad-8d87-eb19040d6e08 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:45 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4ac6668a-36f6-4c92-a5de-67cc81340331 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f1dd5ef5-dd30-43ad-8d87-eb19040d6e08" returned: 0 in 0.116s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:45 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4ac6668a-36f6-4c92-a5de-67cc81340331 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-quobyte-f1dd5ef5-dd30-43ad-8d87-eb19040d6e08" released by "delete_volume" :: held 0.832s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:46 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-4ac6668a-36f6-4c92-a5de-67cc81340331 tempest-CreateVolumesFromSnapshotTest-875283642 None] Created reservations ['5076cc2b-5b51-49d9-b2a9-11c15c597f08', '29d109d6-e597-4de5-a231-58cdeb97e518', 'e873504a-f149-4a9a-9e74-d4e875e5ecab', '129c3eb6-fcd7-4ca2-9570-766a887ac917'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:49:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4ac6668a-36f6-4c92-a5de-67cc81340331 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4ac6668a-36f6-4c92-a5de-67cc81340331 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-4ac6668a-36f6-4c92-a5de-67cc81340331 tempest-CreateVolumesFromSnapshotTest-875283642 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:46 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-4ac6668a-36f6-4c92-a5de-67cc81340331 tempest-CreateVolumesFromSnapshotTest-875283642 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4ac6668a-36f6-4c92-a5de-67cc81340331 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4ac6668a-36f6-4c92-a5de-67cc81340331 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:46 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4ac6668a-36f6-4c92-a5de-67cc81340331 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.109s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:46 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-4ac6668a-36f6-4c92-a5de-67cc81340331 tempest-CreateVolumesFromSnapshotTest-875283642 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:49:46 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-4ac6668a-36f6-4c92-a5de-67cc81340331 tempest-CreateVolumesFromSnapshotTest-875283642 None] Deleted volume successfully.
Sep 22 23:49:47 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4ac6668a-36f6-4c92-a5de-67cc81340331 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-f1dd5ef5-dd30-43ad-8d87-eb19040d6e08-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:47 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3fcbc4cd-90e0-45a4-aa89-3a8598d7f3a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "cinder-792537f7-4dde-41bc-9946-22dc00baea70-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:47 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3fcbc4cd-90e0-45a4-aa89-3a8598d7f3a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-792537f7-4dde-41bc-9946-22dc00baea70-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:47 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-3fcbc4cd-90e0-45a4-aa89-3a8598d7f3a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:47 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3fcbc4cd-90e0-45a4-aa89-3a8598d7f3a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "cinder-quobyte-792537f7-4dde-41bc-9946-22dc00baea70" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:47 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3fcbc4cd-90e0-45a4-aa89-3a8598d7f3a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-quobyte-792537f7-4dde-41bc-9946-22dc00baea70" acquired by "delete_volume" :: waited 0.012s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:47 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf5d244-5127-42aa-b33b-d95babc5172d]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:47 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3fcbc4cd-90e0-45a4-aa89-3a8598d7f3a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-792537f7-4dde-41bc-9946-22dc00baea70 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:48 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:49:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:48 devstack quobyte-client[84065]: System call of process 101541 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:48 devstack quobyte-client[84065]: System call of process 101541 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3fcbc4cd-90e0-45a4-aa89-3a8598d7f3a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-792537f7-4dde-41bc-9946-22dc00baea70" returned: 0 in 0.650s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3fcbc4cd-90e0-45a4-aa89-3a8598d7f3a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-792537f7-4dde-41bc-9946-22dc00baea70 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.317s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:49:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3fcbc4cd-90e0-45a4-aa89-3a8598d7f3a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-792537f7-4dde-41bc-9946-22dc00baea70" returned: 0 in 0.261s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:48 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3fcbc4cd-90e0-45a4-aa89-3a8598d7f3a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-quobyte-792537f7-4dde-41bc-9946-22dc00baea70" released by "delete_volume" :: held 1.070s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:49 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-3fcbc4cd-90e0-45a4-aa89-3a8598d7f3a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Created reservations ['d26801d6-110d-435f-8c2a-1c7158708343', '2379b95f-076b-491b-802b-9ddd2f250128', 'fa24546d-314f-491d-8c8a-ae08ffa553a2', '60ccb6a7-d69c-4c2c-86bc-6c46b2fb7e20'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:49:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3fcbc4cd-90e0-45a4-aa89-3a8598d7f3a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3fcbc4cd-90e0-45a4-aa89-3a8598d7f3a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3fcbc4cd-90e0-45a4-aa89-3a8598d7f3a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:49 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3fcbc4cd-90e0-45a4-aa89-3a8598d7f3a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3fcbc4cd-90e0-45a4-aa89-3a8598d7f3a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3fcbc4cd-90e0-45a4-aa89-3a8598d7f3a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:49 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3fcbc4cd-90e0-45a4-aa89-3a8598d7f3a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.118s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:49 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-3fcbc4cd-90e0-45a4-aa89-3a8598d7f3a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:49:49 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-3fcbc4cd-90e0-45a4-aa89-3a8598d7f3a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Deleted volume successfully.
Sep 22 23:49:49 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3a1b55a7-46e2-44af-abcf-7a0871207d81 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "cinder-caf56306-e5ff-42c5-80a1-c78d4b894ad7-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3a1b55a7-46e2-44af-abcf-7a0871207d81 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-caf56306-e5ff-42c5-80a1-c78d4b894ad7-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3fcbc4cd-90e0-45a4-aa89-3a8598d7f3a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-792537f7-4dde-41bc-9946-22dc00baea70-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:50 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-3a1b55a7-46e2-44af-abcf-7a0871207d81 tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3a1b55a7-46e2-44af-abcf-7a0871207d81 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "cinder-quobyte-caf56306-e5ff-42c5-80a1-c78d4b894ad7" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:50 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3a1b55a7-46e2-44af-abcf-7a0871207d81 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-quobyte-caf56306-e5ff-42c5-80a1-c78d4b894ad7" acquired by "delete_volume" :: waited 0.017s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:50 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[026129d5-5486-4af6-b60f-8d5811c83fe0]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3a1b55a7-46e2-44af-abcf-7a0871207d81 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-caf56306-e5ff-42c5-80a1-c78d4b894ad7 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:50 devstack quobyte-client[84065]: System call of process 101547 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3a1b55a7-46e2-44af-abcf-7a0871207d81 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-caf56306-e5ff-42c5-80a1-c78d4b894ad7" returned: 0 in 0.498s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:50 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3a1b55a7-46e2-44af-abcf-7a0871207d81 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-caf56306-e5ff-42c5-80a1-c78d4b894ad7 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3a1b55a7-46e2-44af-abcf-7a0871207d81 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-caf56306-e5ff-42c5-80a1-c78d4b894ad7" returned: 0 in 0.116s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:51 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3a1b55a7-46e2-44af-abcf-7a0871207d81 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-quobyte-caf56306-e5ff-42c5-80a1-c78d4b894ad7" released by "delete_volume" :: held 0.900s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:51 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-3a1b55a7-46e2-44af-abcf-7a0871207d81 tempest-CreateVolumesFromSnapshotTest-875283642 None] Created reservations ['cbe803de-7b99-4023-a7ed-b34bbc91b784', 'ace50af6-72a9-41da-bf9d-7fe7b6e1c668', '49f6f7cc-9656-4905-9109-f9560ea1b560', '6d8896f2-9908-4f34-8f4b-7f593fdc30fa'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:49:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3a1b55a7-46e2-44af-abcf-7a0871207d81 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3a1b55a7-46e2-44af-abcf-7a0871207d81 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3a1b55a7-46e2-44af-abcf-7a0871207d81 tempest-CreateVolumesFromSnapshotTest-875283642 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:51 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-3a1b55a7-46e2-44af-abcf-7a0871207d81 tempest-CreateVolumesFromSnapshotTest-875283642 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-3a1b55a7-46e2-44af-abcf-7a0871207d81 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:51 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3a1b55a7-46e2-44af-abcf-7a0871207d81 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-3a1b55a7-46e2-44af-abcf-7a0871207d81 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.121s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:52 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-3a1b55a7-46e2-44af-abcf-7a0871207d81 tempest-CreateVolumesFromSnapshotTest-875283642 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:49:52 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-3a1b55a7-46e2-44af-abcf-7a0871207d81 tempest-CreateVolumesFromSnapshotTest-875283642 None] Deleted volume successfully.
Sep 22 23:49:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-3a1b55a7-46e2-44af-abcf-7a0871207d81 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-caf56306-e5ff-42c5-80a1-c78d4b894ad7-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0f194bd5-818f-40ea-9666-713e824082a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "cinder-7aeccf33-675f-4579-9ad6-7973336861de-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0f194bd5-818f-40ea-9666-713e824082a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-7aeccf33-675f-4579-9ad6-7973336861de-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:52 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-0f194bd5-818f-40ea-9666-713e824082a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0f194bd5-818f-40ea-9666-713e824082a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "cinder-quobyte-7aeccf33-675f-4579-9ad6-7973336861de" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:52 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0f194bd5-818f-40ea-9666-713e824082a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-quobyte-7aeccf33-675f-4579-9ad6-7973336861de" acquired by "delete_volume" :: waited 0.029s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:52 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[03835760-9c99-444c-b7e8-acdff6131ca9]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:52 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0f194bd5-818f-40ea-9666-713e824082a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7aeccf33-675f-4579-9ad6-7973336861de {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0f194bd5-818f-40ea-9666-713e824082a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7aeccf33-675f-4579-9ad6-7973336861de" returned: 0 in 0.580s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0f194bd5-818f-40ea-9666-713e824082a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7aeccf33-675f-4579-9ad6-7973336861de {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:53 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0f194bd5-818f-40ea-9666-713e824082a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-7aeccf33-675f-4579-9ad6-7973336861de" returned: 0 in 0.129s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:53 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0f194bd5-818f-40ea-9666-713e824082a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-quobyte-7aeccf33-675f-4579-9ad6-7973336861de" released by "delete_volume" :: held 0.944s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:54 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:SELECT=80,cinder:UPDATE=122,cinder:DELETE=14,cinder:INSERT=26 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:49:54 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=129,cinder:SELECT=91,cinder:DELETE=13,cinder:INSERT=31 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:49:54 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-0f194bd5-818f-40ea-9666-713e824082a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Created reservations ['de2a97ab-823c-4028-9102-c88309af5c5b', '1b0d8f81-0f3f-4683-a5b0-4bae41d4987c', 'd78ee8f1-39da-452d-b960-bb25ee07ab79', 'b4091251-afcd-4d44-a71a-08c778ef91c2'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:49:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0f194bd5-818f-40ea-9666-713e824082a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0f194bd5-818f-40ea-9666-713e824082a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0f194bd5-818f-40ea-9666-713e824082a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:54 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0f194bd5-818f-40ea-9666-713e824082a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0f194bd5-818f-40ea-9666-713e824082a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0f194bd5-818f-40ea-9666-713e824082a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:54 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0f194bd5-818f-40ea-9666-713e824082a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.118s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:54 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-0f194bd5-818f-40ea-9666-713e824082a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:49:54 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-0f194bd5-818f-40ea-9666-713e824082a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Deleted volume successfully.
Sep 22 23:49:54 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-0f194bd5-818f-40ea-9666-713e824082a6 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-7aeccf33-675f-4579-9ad6-7973336861de-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:55 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9620f281-254e-485c-a1b9-b16fcf9e6232 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "cinder-a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:55 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9620f281-254e-485c-a1b9-b16fcf9e6232 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:55 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-9620f281-254e-485c-a1b9-b16fcf9e6232 tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:55 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9620f281-254e-485c-a1b9-b16fcf9e6232 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "cinder-quobyte-a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:55 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9620f281-254e-485c-a1b9-b16fcf9e6232 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-quobyte-a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65" acquired by "delete_volume" :: waited 0.015s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:55 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcba93e-a0e3-4cb6-b59d-eb417c4f0354]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:55 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9620f281-254e-485c-a1b9-b16fcf9e6232 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:56 devstack quobyte-client[84065]: System call of process 101558 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9620f281-254e-485c-a1b9-b16fcf9e6232 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65" returned: 0 in 0.524s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9620f281-254e-485c-a1b9-b16fcf9e6232 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:56 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9620f281-254e-485c-a1b9-b16fcf9e6232 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65" returned: 0 in 0.126s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:56 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9620f281-254e-485c-a1b9-b16fcf9e6232 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-quobyte-a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65" released by "delete_volume" :: held 0.893s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:56 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-9620f281-254e-485c-a1b9-b16fcf9e6232 tempest-CreateVolumesFromSnapshotTest-875283642 None] Created reservations ['0df9d451-cc14-4efd-b042-217b2633a6d0', '83b0a8b1-7540-4697-b45f-91ed48217ec3', '9d2e909b-892c-4079-962d-4d3723a8e39b', '9c41e30a-f9c1-486e-99a2-51a3b71ba7c4'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:49:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9620f281-254e-485c-a1b9-b16fcf9e6232 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:49:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9620f281-254e-485c-a1b9-b16fcf9e6232 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:49:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-9620f281-254e-485c-a1b9-b16fcf9e6232 tempest-CreateVolumesFromSnapshotTest-875283642 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:49:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-9620f281-254e-485c-a1b9-b16fcf9e6232 tempest-CreateVolumesFromSnapshotTest-875283642 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:49:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9620f281-254e-485c-a1b9-b16fcf9e6232 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:49:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9620f281-254e-485c-a1b9-b16fcf9e6232 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9620f281-254e-485c-a1b9-b16fcf9e6232 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.122s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:57 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-9620f281-254e-485c-a1b9-b16fcf9e6232 tempest-CreateVolumesFromSnapshotTest-875283642 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:49:57 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-9620f281-254e-485c-a1b9-b16fcf9e6232 tempest-CreateVolumesFromSnapshotTest-875283642 None] Deleted volume successfully.
Sep 22 23:49:57 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9620f281-254e-485c-a1b9-b16fcf9e6232 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-a4b4d3fc-4f81-4d4a-bd9e-a42253aa9b65-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:57 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "cinder-7e43f002-3b97-413f-a550-c6d4e6032a81-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:57 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-7e43f002-3b97-413f-a550-c6d4e6032a81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:57 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:49:57 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "cinder-quobyte-a0a90f22-3660-4a7d-b563-b4035d7c00e9" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:57 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-quobyte-a0a90f22-3660-4a7d-b563-b4035d7c00e9" acquired by "delete_snapshot" :: waited 0.034s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:57 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "cinder-quobyte-7e43f002-3b97-413f-a550-c6d4e6032a81" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:49:57 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-quobyte-7e43f002-3b97-413f-a550-c6d4e6032a81" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:49:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] Deleting offline snapshot 7e43f002-3b97-413f-a550-c6d4e6032a81 of volume a0a90f22-3660-4a7d-b563-b4035d7c00e9 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:49:57 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] snapshot_file for this snap is: volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.7e43f002-3b97-413f-a550-c6d4e6032a81 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:49:57 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcda2cf9-785f-4487-a8a2-2cd702a1129e]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:57 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.7e43f002-3b97-413f-a550-c6d4e6032a81 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:58 devstack quobyte-client[84065]: System call of process 101565 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.7e43f002-3b97-413f-a550-c6d4e6032a81" returned: 0 in 0.528s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:58 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:49:58 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fe1167-62d5-4ee4-a65c-1105a8e5f739]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:49:58 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:58 devstack quobyte-client[84065]: System call of process 101568 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:49:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9" returned: 0 in 0.502s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.7e43f002-3b97-413f-a550-c6d4e6032a81 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.7e43f002-3b97-413f-a550-c6d4e6032a81" returned: 0 in 0.266s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.7e43f002-3b97-413f-a550-c6d4e6032a81 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:49:59 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9.7e43f002-3b97-413f-a550-c6d4e6032a81" returned: 0 in 0.124s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:49:59 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-quobyte-7e43f002-3b97-413f-a550-c6d4e6032a81" released by "_delete_snapshot" :: held 1.858s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:49:59 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-quobyte-a0a90f22-3660-4a7d-b563-b4035d7c00e9" released by "delete_snapshot" :: held 1.893s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:00 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] Created reservations ['6fb5ddab-555a-436e-bbc8-cb35221ee1f4', 'e1cb1ed8-85d3-4bf4-bffa-99dc9d02b8fe', '23aaa1e9-34f2-484c-8c3c-49898088ae1d', 'f17abf9d-9eb0-4975-94aa-5745959e8b11'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:50:00 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] Delete snapshot completed successfully.
Sep 22 23:50:00 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-29060dcd-bd86-44e0-af84-ab72bf957211 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-7e43f002-3b97-413f-a550-c6d4e6032a81-delete_snapshot" released by "delete_snapshot" :: held 2.847s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:01 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-fa005078-4037-4cec-996e-1eac1a9bcd00 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "cinder-a0a90f22-3660-4a7d-b563-b4035d7c00e9-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:01 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-fa005078-4037-4cec-996e-1eac1a9bcd00 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-a0a90f22-3660-4a7d-b563-b4035d7c00e9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:01 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-fa005078-4037-4cec-996e-1eac1a9bcd00 tempest-CreateVolumesFromSnapshotTest-875283642 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:50:01 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-fa005078-4037-4cec-996e-1eac1a9bcd00 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "cinder-quobyte-a0a90f22-3660-4a7d-b563-b4035d7c00e9" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:01 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-fa005078-4037-4cec-996e-1eac1a9bcd00 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-quobyte-a0a90f22-3660-4a7d-b563-b4035d7c00e9" acquired by "delete_volume" :: waited 0.014s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:01 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fe0354-8586-40bc-b184-bed0e70240fe]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:50:01 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fa005078-4037-4cec-996e-1eac1a9bcd00 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fa005078-4037-4cec-996e-1eac1a9bcd00 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9" returned: 0 in 0.615s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fa005078-4037-4cec-996e-1eac1a9bcd00 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fa005078-4037-4cec-996e-1eac1a9bcd00 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-a0a90f22-3660-4a7d-b563-b4035d7c00e9" returned: 0 in 0.125s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:02 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-fa005078-4037-4cec-996e-1eac1a9bcd00 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-quobyte-a0a90f22-3660-4a7d-b563-b4035d7c00e9" released by "delete_volume" :: held 0.959s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:02 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-fa005078-4037-4cec-996e-1eac1a9bcd00 tempest-CreateVolumesFromSnapshotTest-875283642 None] Created reservations ['1fafe5da-05c9-45df-8211-7ec76b030190', '48793a08-be48-4aa7-aee0-c7a093ad96c8', 'aff886e4-5ba5-448c-ba3f-0a0380b27ff5', '64f9c000-1a30-4765-a129-e311c4b16772'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:50:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fa005078-4037-4cec-996e-1eac1a9bcd00 tempest-CreateVolumesFromSnapshotTest-875283642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:02 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fa005078-4037-4cec-996e-1eac1a9bcd00 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:02 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fa005078-4037-4cec-996e-1eac1a9bcd00 tempest-CreateVolumesFromSnapshotTest-875283642 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:50:03 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-fa005078-4037-4cec-996e-1eac1a9bcd00 tempest-CreateVolumesFromSnapshotTest-875283642 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:50:03 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-fa005078-4037-4cec-996e-1eac1a9bcd00 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:03 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fa005078-4037-4cec-996e-1eac1a9bcd00 tempest-CreateVolumesFromSnapshotTest-875283642 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:03 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-fa005078-4037-4cec-996e-1eac1a9bcd00 tempest-CreateVolumesFromSnapshotTest-875283642 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.176s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:03 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-fa005078-4037-4cec-996e-1eac1a9bcd00 tempest-CreateVolumesFromSnapshotTest-875283642 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:50:03 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-fa005078-4037-4cec-996e-1eac1a9bcd00 tempest-CreateVolumesFromSnapshotTest-875283642 None] Deleted volume successfully.
Sep 22 23:50:03 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-fa005078-4037-4cec-996e-1eac1a9bcd00 tempest-CreateVolumesFromSnapshotTest-875283642 None] Lock "cinder-a0a90f22-3660-4a7d-b563-b4035d7c00e9-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:05 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Flow 'volume_create_manager' (50449745-938b-4582-adf4-1fddd258a3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23afb759-4c73-45d2-b214-4271a5b02b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23afb759-4c73-45d2-b214-4271a5b02b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1532871938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f798c068-90f4-48c0-9b7c-dd0e3f1acae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88629006d01455c832a8d0b6f742ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:50:05Z,use_quota=True,user_id='3262446c29434599b67f6225328ea0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8bdf3b-8e75-4f58-ac4f-1f87ce53c012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab8bdf3b-8e75-4f58-ac4f-1f87ce53c012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4c7d53-8515-4138-859a-efe946947fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4c7d53-8515-4138-859a-efe946947fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f798c068-90f4-48c0-9b7c-dd0e3f1acae5', 'volume_name': 'volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9610ef13-ebe1-4cca-9356-935b72a12413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9610ef13-ebe1-4cca-9356-935b72a12413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9578723d-21f9-41a8-97c6-e61746ac6d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:05 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Volume f798c068-90f4-48c0-9b7c-dd0e3f1acae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5', 'volume_size': 1}
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1532871938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f798c068-90f4-48c0-9b7c-dd0e3f1acae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88629006d01455c832a8d0b6f742ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:50:05Z,use_quota=True,user_id='3262446c29434599b67f6225328ea0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Creating volume f798c068-90f4-48c0-9b7c-dd0e3f1acae5 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:50:05 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:05 devstack quobyte-client[84065]: System call of process 101618 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:05 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=164, name=volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5 1073741824" returned: 0 in 0.402s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:05 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5" returned: 0 in 0.156s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:06 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] <== create_volume: return (652ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:50:06 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9578723d-21f9-41a8-97c6-e61746ac6d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be187d53-2bef-4f48-b20f-7eebfc420294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:06 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Volume volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5 (f798c068-90f4-48c0-9b7c-dd0e3f1acae5): created successfully
Sep 22 23:50:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be187d53-2bef-4f48-b20f-7eebfc420294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:06 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Flow 'volume_create_manager' (50449745-938b-4582-adf4-1fddd258a3d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:50:06 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-2a400284-3288-41a2-b023-4034f057792a tempest-SnapshotDependencyTests-1543237351 None] Created volume successfully.
Sep 22 23:50:07 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Flow 'volume_create_manager' (bb61e44b-3b38-452d-88da-ba381f003bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6f2ae5-76ed-4bc1-9cab-103f9926d7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6f2ae5-76ed-4bc1-9cab-103f9926d7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1903306226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc193bd-fc33-408a-a69b-9c9206c907b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dfb649e208348cc8d1bca9dda451fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:50:07Z,use_quota=True,user_id='a7ba6bbb445b4da197c8f0a5f166fd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dac4189-bca2-4fd8-b2ea-a06b0188ac38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dac4189-bca2-4fd8-b2ea-a06b0188ac38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93004e41-1e04-4372-a9c2-b5a636110c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93004e41-1e04-4372-a9c2-b5a636110c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cc193bd-fc33-408a-a69b-9c9206c907b5', 'volume_name': 'volume-2cc193bd-fc33-408a-a69b-9c9206c907b5', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89f3e9d-14f7-434a-9000-d7eae10d5535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89f3e9d-14f7-434a-9000-d7eae10d5535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6db23c-a650-4313-8f78-80bd9dd761bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:07 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume 2cc193bd-fc33-408a-a69b-9c9206c907b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cc193bd-fc33-408a-a69b-9c9206c907b5', 'volume_size': 1}
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1903306226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc193bd-fc33-408a-a69b-9c9206c907b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dfb649e208348cc8d1bca9dda451fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:50:07Z,use_quota=True,user_id='a7ba6bbb445b4da197c8f0a5f166fd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Creating volume 2cc193bd-fc33-408a-a69b-9c9206c907b5 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:50:07 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:50:07 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cc193bd-fc33-408a-a69b-9c9206c907b5 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:07 devstack quobyte-client[84065]: System call of process 101623 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:07 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=165, name=volume-2cc193bd-fc33-408a-a69b-9c9206c907b5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:50:08 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:50:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cc193bd-fc33-408a-a69b-9c9206c907b5 1073741824" returned: 0 in 0.489s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cc193bd-fc33-408a-a69b-9c9206c907b5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cc193bd-fc33-408a-a69b-9c9206c907b5" returned: 0 in 0.090s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:08 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] <== create_volume: return (628ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:50:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.641s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.374s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:08 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6db23c-a650-4313-8f78-80bd9dd761bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cc193bd-fc33-408a-a69b-9c9206c907b5', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:08 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0614871-e5d1-4b42-9c23-d93e74d37bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:08 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] Creating offline snapshot 999b5af2-4bb3-40b8-a67d-3b85f23d3cd8 of volume f798c068-90f4-48c0-9b7c-dd0e3f1acae5 {{(pid=84012) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 22 23:50:08 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[87275323-042b-4c54-8750-de54c7b7822e]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:50:08 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:08 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume volume-2cc193bd-fc33-408a-a69b-9c9206c907b5 (2cc193bd-fc33-408a-a69b-9c9206c907b5): created successfully
Sep 22 23:50:08 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0614871-e5d1-4b42-9c23-d93e74d37bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:08 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Flow 'volume_create_manager' (bb61e44b-3b38-452d-88da-ba381f003bd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:50:09 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-bab45c28-d5a8-4fb3-850c-ad3569795a97 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Created volume successfully.
Sep 22 23:50:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5" returned: 0 in 0.552s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.999b5af2-4bb3-40b8-a67d-3b85f23d3cd8 1G {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:09 devstack quobyte-client[84065]: System call of process 101630 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:09 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=166, name=volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.999b5af2-4bb3-40b8-a67d-3b85f23d3cd8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:50:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.999b5af2-4bb3-40b8-a67d-3b85f23d3cd8 1G" returned: 0 in 0.294s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.999b5af2-4bb3-40b8-a67d-3b85f23d3cd8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] CMD "qemu-img rebase -u -b volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5 -F qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.999b5af2-4bb3-40b8-a67d-3b85f23d3cd8" returned: 0 in 0.162s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:09 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.999b5af2-4bb3-40b8-a67d-3b85f23d3cd8 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:50:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.999b5af2-4bb3-40b8-a67d-3b85f23d3cd8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:09 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.999b5af2-4bb3-40b8-a67d-3b85f23d3cd8" returned: 0 in 0.140s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:09 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] Setting permissions: /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5 -> 1000:1000 {{(pid=84012) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 22 23:50:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.999b5af2-4bb3-40b8-a67d-3b85f23d3cd8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.999b5af2-4bb3-40b8-a67d-3b85f23d3cd8" returned: 0 in 0.445s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:10 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:10 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:50:10 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Flow 'volume_create_manager' (1b2bcfb4-c1a5-4ed5-9065-5a1dd27993ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13319b3f-a47b-48f8-b42d-c1c407655b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.info" returned: 0 in 0.590s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.info is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.info {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13319b3f-a47b-48f8-b42d-c1c407655b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-691633947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33310876-62fc-445b-a499-b31e74044870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dfb649e208348cc8d1bca9dda451fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:50:10Z,use_quota=True,user_id='a7ba6bbb445b4da197c8f0a5f166fd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1637adff-ae0a-49be-87df-ea2a5f22c305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1637adff-ae0a-49be-87df-ea2a5f22c305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1e3ca3-dce9-43b1-9568-824bc4ca9cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1e3ca3-dce9-43b1-9568-824bc4ca9cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33310876-62fc-445b-a499-b31e74044870', 'volume_name': 'volume-33310876-62fc-445b-a499-b31e74044870', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600783b2-3530-47d2-92ca-3d08b5809ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600783b2-3530-47d2-92ca-3d08b5809ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3045ee1b-9e13-4d9c-9abf-c2b529a55350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:11 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume 33310876-62fc-445b-a499-b31e74044870: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33310876-62fc-445b-a499-b31e74044870', 'volume_size': 1}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.info" returned: 0 in 0.564s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.214s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:11 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Flow 'volume_create_manager' (3407089d-41e6-4767-8323-e5b484b28688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6a76e9-6fc5-4357-af35-10eb0eed195c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.171s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-691633947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33310876-62fc-445b-a499-b31e74044870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dfb649e208348cc8d1bca9dda451fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:50:10Z,use_quota=True,user_id='a7ba6bbb445b4da197c8f0a5f166fd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Creating volume 33310876-62fc-445b-a499-b31e74044870 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:50:11 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:50:11 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-33310876-62fc-445b-a499-b31e74044870 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:11 devstack quobyte-client[84065]: System call of process 101640 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:11 devstack quobyte-client[84065]: System call of process 101640 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:11 devstack quobyte-client[84065]: System call of process 101640 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:11 devstack quobyte-client[84065]: System call of process 101640 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:11 devstack quobyte-client[84065]: System call of process 101640 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:11 devstack quobyte-client[84065]: System call of process 101640 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:12 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=168, name=volume-33310876-62fc-445b-a499-b31e74044870, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6a76e9-6fc5-4357-af35-10eb0eed195c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-494737055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b2bdc9-706d-49f3-9311-1f33dc9edd6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dfb649e208348cc8d1bca9dda451fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:50:11Z,use_quota=True,user_id='a7ba6bbb445b4da197c8f0a5f166fd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (012bf56e-abf1-4e05-bae5-63a5514c473d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (012bf56e-abf1-4e05-bae5-63a5514c473d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca98dd5-8858-479e-bac2-4551faa227d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca98dd5-8858-479e-bac2-4551faa227d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65b2bdc9-706d-49f3-9311-1f33dc9edd6d', 'volume_name': 'volume-65b2bdc9-706d-49f3-9311-1f33dc9edd6d', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13fc010-a117-43b6-b3ff-8ea992d3ef03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13fc010-a117-43b6-b3ff-8ea992d3ef03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a6155a-f7ac-4053-962c-a731ecf2fa12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:12 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume 65b2bdc9-706d-49f3-9311-1f33dc9edd6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65b2bdc9-706d-49f3-9311-1f33dc9edd6d', 'volume_size': 1}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:12 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Flow 'volume_create_manager' (530404a1-2e5a-4078-8bd5-20667be3f52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5756407b-bebc-42dc-bbf7-22970c3fa061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:12 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-b754555e-de88-44f2-80d8-30e6eeea9647 tempest-SnapshotDependencyTests-1543237351 None] Create snapshot completed successfully
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-33310876-62fc-445b-a499-b31e74044870 1073741824" returned: 0 in 0.700s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-33310876-62fc-445b-a499-b31e74044870 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5756407b-bebc-42dc-bbf7-22970c3fa061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644528786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=962b2c52-8716-41c9-b6b4-81f6b968242f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dfb649e208348cc8d1bca9dda451fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:50:11Z,use_quota=True,user_id='a7ba6bbb445b4da197c8f0a5f166fd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c61e356-da61-4353-94ed-3221a989b830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c61e356-da61-4353-94ed-3221a989b830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf771f0-e696-466f-a24a-9ff90c58506f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf771f0-e696-466f-a24a-9ff90c58506f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '962b2c52-8716-41c9-b6b4-81f6b968242f', 'volume_name': 'volume-962b2c52-8716-41c9-b6b4-81f6b968242f', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721c8d3a-d2c6-4410-b068-1f412ba9fc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (721c8d3a-d2c6-4410-b068-1f412ba9fc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84282356-d8f7-4b40-bff3-909de0980911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:12 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume 962b2c52-8716-41c9-b6b4-81f6b968242f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-962b2c52-8716-41c9-b6b4-81f6b968242f', 'volume_size': 1}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:12 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Flow 'volume_create_manager' (88c4d4c2-c8d1-4cdf-849e-7119c7223bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:50:12 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4430742-37a4-4279-af77-611e1c5b467d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-33310876-62fc-445b-a499-b31e74044870" returned: 0 in 0.538s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] <== create_volume: return (1263ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4430742-37a4-4279-af77-611e1c5b467d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-916737905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced37940-d658-4893-879c-ff078e19ce43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dfb649e208348cc8d1bca9dda451fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:50:12Z,use_quota=True,user_id='a7ba6bbb445b4da197c8f0a5f166fd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (867da28f-08d0-49a5-9dc3-8a711f63d469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (867da28f-08d0-49a5-9dc3-8a711f63d469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd61870-db15-497c-8498-0da870a44521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd61870-db15-497c-8498-0da870a44521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ced37940-d658-4893-879c-ff078e19ce43', 'volume_name': 'volume-ced37940-d658-4893-879c-ff078e19ce43', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc878ed0-8ef2-411b-af1d-e57ec92233cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc878ed0-8ef2-411b-af1d-e57ec92233cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc65b27-c0db-4e40-96fd-b2e244156450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:13 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume ced37940-d658-4893-879c-ff078e19ce43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ced37940-d658-4893-879c-ff078e19ce43', 'volume_size': 1}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-916737905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced37940-d658-4893-879c-ff078e19ce43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dfb649e208348cc8d1bca9dda451fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:50:12Z,use_quota=True,user_id='a7ba6bbb445b4da197c8f0a5f166fd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Creating volume ced37940-d658-4893-879c-ff078e19ce43 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:50:13 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ced37940-d658-4893-879c-ff078e19ce43 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:13 devstack quobyte-client[84065]: System call of process 101644 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:13 devstack quobyte-client[84065]: System call of process 101644 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:13 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=169, name=volume-ced37940-d658-4893-879c-ff078e19ce43, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:50:13 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Flow 'volume_create_manager' (23b433ac-a5da-4051-a664-84b294a82189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09165deb-67ce-4ffb-b5f3-837f433f8598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09165deb-67ce-4ffb-b5f3-837f433f8598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-283729275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ba7eb77-f744-49ff-8e91-2f6c39660b23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dfb649e208348cc8d1bca9dda451fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:50:12Z,use_quota=True,user_id='a7ba6bbb445b4da197c8f0a5f166fd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554d6dbc-fb78-425e-ae49-8f3adc4ff21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554d6dbc-fb78-425e-ae49-8f3adc4ff21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e7c0cf-bdcb-4034-92a3-e0fe33b9f23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e7c0cf-bdcb-4034-92a3-e0fe33b9f23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ba7eb77-f744-49ff-8e91-2f6c39660b23', 'volume_name': 'volume-0ba7eb77-f744-49ff-8e91-2f6c39660b23', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a5b15f-75ee-4895-a500-fb227e9eb9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a5b15f-75ee-4895-a500-fb227e9eb9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f76d78-e0ce-4f43-838e-35b1ab016b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:13 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume 0ba7eb77-f744-49ff-8e91-2f6c39660b23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ba7eb77-f744-49ff-8e91-2f6c39660b23', 'volume_size': 1}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3045ee1b-9e13-4d9c-9abf-c2b529a55350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33310876-62fc-445b-a499-b31e74044870', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68402b1-36db-43c3-9b94-a0c7dadd7aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ced37940-d658-4893-879c-ff078e19ce43 1073741824" returned: 0 in 0.671s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:13 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ced37940-d658-4893-879c-ff078e19ce43 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:14 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume volume-33310876-62fc-445b-a499-b31e74044870 (33310876-62fc-445b-a499-b31e74044870): created successfully
Sep 22 23:50:14 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68402b1-36db-43c3-9b94-a0c7dadd7aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:14 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Flow 'volume_create_manager' (1b2bcfb4-c1a5-4ed5-9065-5a1dd27993ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:50:14 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-caf99447-495e-4089-a18c-bd9965ce925d tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Created volume successfully.
Sep 22 23:50:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ced37940-d658-4893-879c-ff078e19ce43" returned: 0 in 0.419s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] <== create_volume: return (1121ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:50:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.382s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644528786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=962b2c52-8716-41c9-b6b4-81f6b968242f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dfb649e208348cc8d1bca9dda451fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:50:11Z,use_quota=True,user_id='a7ba6bbb445b4da197c8f0a5f166fd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:50:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Creating volume 962b2c52-8716-41c9-b6b4-81f6b968242f {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:50:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:50:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:50:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:14 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:50:14 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:50:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-962b2c52-8716-41c9-b6b4-81f6b968242f 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:14 devstack quobyte-client[84065]: System call of process 101648 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:14 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=170, name=volume-962b2c52-8716-41c9-b6b4-81f6b968242f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:50:14 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:50:14 devstack cinder-volume[84012]: DEBUG cinder.volume.flows.manager.create_volume [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84012) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 22 23:50:14 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc65b27-c0db-4e40-96fd-b2e244156450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced37940-d658-4893-879c-ff078e19ce43', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:14 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee50b32-73b8-4125-8724-ffd36d6e21b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-962b2c52-8716-41c9-b6b4-81f6b968242f 1073741824" returned: 0 in 0.592s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:14 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-962b2c52-8716-41c9-b6b4-81f6b968242f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Flow 'volume_create_manager' (001eb5ae-ee47-45b0-80de-2e1d44f33dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b6ae23-44e3-4e37-9754-1cd41aa1e606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:15 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume volume-ced37940-d658-4893-879c-ff078e19ce43 (ced37940-d658-4893-879c-ff078e19ce43): created successfully
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee50b32-73b8-4125-8724-ffd36d6e21b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Flow 'volume_create_manager' (88c4d4c2-c8d1-4cdf-849e-7119c7223bb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b6ae23-44e3-4e37-9754-1cd41aa1e606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8aa736-abaf-46be-aea0-97639c5e2680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b88629006d01455c832a8d0b6f742ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=999b5af2-4bb3-40b8-a67d-3b85f23d3cd8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:50:14Z,use_quota=True,user_id='3262446c29434599b67f6225328ea0c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (505c307d-5ce9-4d0f-bc9d-7c6cbd12eb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (505c307d-5ce9-4d0f-bc9d-7c6cbd12eb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb5a40a-dad1-4b51-ae70-fd1721f43b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb5a40a-dad1-4b51-ae70-fd1721f43b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aa8aa736-abaf-46be-aea0-97639c5e2680', 'volume_name': 'volume-aa8aa736-abaf-46be-aea0-97639c5e2680', 'volume_size': 1, 'snapshot_id': '999b5af2-4bb3-40b8-a67d-3b85f23d3cd8'}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dbd7af8-5306-487e-a62f-e2205747ef25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dbd7af8-5306-487e-a62f-e2205747ef25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d78fa80-b18d-4d9f-a756-0627edcb1316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:15 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Volume aa8aa736-abaf-46be-aea0-97639c5e2680: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aa8aa736-abaf-46be-aea0-97639c5e2680', 'volume_size': 1, 'snapshot_id': '999b5af2-4bb3-40b8-a67d-3b85f23d3cd8'}
Sep 22 23:50:15 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-78126d73-5d22-4db8-8e15-024b355f211e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Created volume successfully.
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-962b2c52-8716-41c9-b6b4-81f6b968242f" returned: 0 in 0.547s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] <== create_volume: return (1167ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.077s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-494737055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b2bdc9-706d-49f3-9311-1f33dc9edd6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dfb649e208348cc8d1bca9dda451fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:50:11Z,use_quota=True,user_id='a7ba6bbb445b4da197c8f0a5f166fd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Creating volume 65b2bdc9-706d-49f3-9311-1f33dc9edd6d {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:50:15 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-65b2bdc9-706d-49f3-9311-1f33dc9edd6d 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:15 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=171, name=volume-65b2bdc9-706d-49f3-9311-1f33dc9edd6d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84282356-d8f7-4b40-bff3-909de0980911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-962b2c52-8716-41c9-b6b4-81f6b968242f', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd424652-8d88-4938-bd34-9fad924d6618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:15 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume volume-962b2c52-8716-41c9-b6b4-81f6b968242f (962b2c52-8716-41c9-b6b4-81f6b968242f): created successfully
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd424652-8d88-4938-bd34-9fad924d6618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Flow 'volume_create_manager' (530404a1-2e5a-4078-8bd5-20667be3f52f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-65b2bdc9-706d-49f3-9311-1f33dc9edd6d 1073741824" returned: 0 in 0.483s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:15 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-65b2bdc9-706d-49f3-9311-1f33dc9edd6d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:16 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-02590997-9642-4290-a511-8e74e3015862 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Created volume successfully.
Sep 22 23:50:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-65b2bdc9-706d-49f3-9311-1f33dc9edd6d" returned: 0 in 0.341s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] <== create_volume: return (870ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:50:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.624s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0d1043bfa0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-22T21:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-283729275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ba7eb77-f744-49ff-8e91-2f6c39660b23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dfb649e208348cc8d1bca9dda451fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T21:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T21:50:12Z,use_quota=True,user_id='a7ba6bbb445b4da197c8f0a5f166fd47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07f85021-48e2-44cb-a1d6-503922a8bfe7),volume_type_id=07f85021-48e2-44cb-a1d6-503922a8bfe7)}" {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 22 23:50:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Creating volume 0ba7eb77-f744-49ff-8e91-2f6c39660b23 {{(pid=84012) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 22 23:50:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:50:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:50:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:16 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:50:16 devstack cinder-volume[84012]: INFO cinder.volume.drivers.remotefs [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] casted to 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f
Sep 22 23:50:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0ba7eb77-f744-49ff-8e91-2f6c39660b23 1073741824 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:16 devstack quobyte-client[84065]: System call of process 101656 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:16 devstack quobyte-client[84065]: System call of process 101656 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:16 devstack quobyte-client[84065]: System call of process 101656 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:16 devstack quobyte-client[84065]: System call of process 101656 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:16 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=172, name=volume-0ba7eb77-f744-49ff-8e91-2f6c39660b23, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:50:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a6155a-f7ac-4053-962c-a731ecf2fa12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65b2bdc9-706d-49f3-9311-1f33dc9edd6d', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d242fda2-45aa-41fc-a815-9a3570ce90de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:16 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume volume-65b2bdc9-706d-49f3-9311-1f33dc9edd6d (65b2bdc9-706d-49f3-9311-1f33dc9edd6d): created successfully
Sep 22 23:50:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d242fda2-45aa-41fc-a815-9a3570ce90de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:16 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Flow 'volume_create_manager' (3407089d-41e6-4767-8323-e5b484b28688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:50:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0ba7eb77-f744-49ff-8e91-2f6c39660b23 1073741824" returned: 0 in 0.470s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:16 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0ba7eb77-f744-49ff-8e91-2f6c39660b23 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:16 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-0b91a223-79cc-4e4f-a7fe-5496bafe22b1 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Created volume successfully.
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0ba7eb77-f744-49ff-8e91-2f6c39660b23" returned: 0 in 0.256s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] <== create_volume: return (759ms) {'provider_location': '10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'} {{(pid=84012) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.482s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Acquiring lock "cinder-quobyte-999b5af2-4bb3-40b8-a67d-3b85f23d3cd8-aa8aa736-abaf-46be-aea0-97639c5e2680" by "_create_volume_from_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f76d78-e0ce-4f43-838e-35b1ab016b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ba7eb77-f744-49ff-8e91-2f6c39660b23', 'volume_size': 1}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec6f346-9442-4af1-a150-36d3c6eb4615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Lock "cinder-quobyte-999b5af2-4bb3-40b8-a67d-3b85f23d3cd8-aa8aa736-abaf-46be-aea0-97639c5e2680" acquired by "_create_volume_from_snapshot" :: waited 0.127s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Creating volume aa8aa736-abaf-46be-aea0-97639c5e2680 from snapshot 999b5af2-4bb3-40b8-a67d-3b85f23d3cd8 {{(pid=84012) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Selected 10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f as target Quobyte volume. {{(pid=84012) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Acquiring lock "cinder-quobyte-aa8aa736-abaf-46be-aea0-97639c5e2680" by "_copy_volume_from_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Lock "cinder-quobyte-aa8aa736-abaf-46be-aea0-97639c5e2680" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] snapshot: 999b5af2-4bb3-40b8-a67d-3b85f23d3cd8, volume: aa8aa736-abaf-46be-aea0-97639c5e2680,  {{(pid=84012) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 22 23:50:17 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume volume-0ba7eb77-f744-49ff-8e91-2f6c39660b23 (0ba7eb77-f744-49ff-8e91-2f6c39660b23): created successfully
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec6f346-9442-4af1-a150-36d3c6eb4615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Flow 'volume_create_manager' (23b433ac-a5da-4051-a664-84b294a82189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:17 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-51027e03-fda7-4f99-bb98-81438a0ce65f tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Created volume successfully.
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[49935a77-ab5d-48ac-96d6-ab1ba2b84c5c]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.999b5af2-4bb3-40b8-a67d-3b85f23d3cd8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:17 devstack quobyte-client[84065]: System call of process 101661 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:17 devstack quobyte-client[84065]: System call of process 101661 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:17 devstack quobyte-client[84065]: System call of process 101661 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.999b5af2-4bb3-40b8-a67d-3b85f23d3cd8" returned: 0 in 0.425s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5 {{(pid=84012) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 22 23:50:17 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Creating direct copy from snapshot {{(pid=84012) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 22 23:50:18 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d7b95d-26f0-4f2b-98b4-387b93576d51]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:50:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:18 devstack quobyte-client[84065]: System call of process 101664 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5" returned: 0 in 0.474s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:18 devstack cinder-volume[84012]: DEBUG cinder.utils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa8aa736-abaf-46be-aea0-97639c5e2680 not found in is_blk_device check {{(pid=84012) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 22 23:50:18 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa8aa736-abaf-46be-aea0-97639c5e2680 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:18 devstack quobyte-client[84065]: System call of process 101667 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:18 devstack quobyte-client[84065]: System call of process 101667 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4c170eeb-af6b-43a2-8e6c-2aba25efd133 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "cinder-0ba7eb77-f744-49ff-8e91-2f6c39660b23-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:18 devstack quobyte-client[84065]: The server volume:a50e2da2-2670-46c7-aa52-a5bba043dd00@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=a50e2da2-2670-46c7-aa52-a5bba043dd00, inode=173, name=volume-aa8aa736-abaf-46be-aea0-97639c5e2680, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.128), requestorAccessMask=0
Sep 22 23:50:18 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4c170eeb-af6b-43a2-8e6c-2aba25efd133 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-0ba7eb77-f744-49ff-8e91-2f6c39660b23-delete_volume" acquired by "delete_volume" :: waited 0.157s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:19 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-4c170eeb-af6b-43a2-8e6c-2aba25efd133 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:50:19 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4c170eeb-af6b-43a2-8e6c-2aba25efd133 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "cinder-quobyte-0ba7eb77-f744-49ff-8e91-2f6c39660b23" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:19 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4c170eeb-af6b-43a2-8e6c-2aba25efd133 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-quobyte-0ba7eb77-f744-49ff-8e91-2f6c39660b23" acquired by "delete_volume" :: waited 0.040s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:19 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ce421e-85b8-4536-8145-582d74f36f62]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:50:19 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4c170eeb-af6b-43a2-8e6c-2aba25efd133 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0ba7eb77-f744-49ff-8e91-2f6c39660b23 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:21 devstack quobyte-client[84065]: System call of process 101677 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:21 devstack quobyte-client[84065]: System call of process 101677 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4c170eeb-af6b-43a2-8e6c-2aba25efd133 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0ba7eb77-f744-49ff-8e91-2f6c39660b23" returned: 0 in 1.532s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4c170eeb-af6b-43a2-8e6c-2aba25efd133 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0ba7eb77-f744-49ff-8e91-2f6c39660b23 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:21 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4c170eeb-af6b-43a2-8e6c-2aba25efd133 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-0ba7eb77-f744-49ff-8e91-2f6c39660b23" returned: 0 in 0.435s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:22 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4c170eeb-af6b-43a2-8e6c-2aba25efd133 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-quobyte-0ba7eb77-f744-49ff-8e91-2f6c39660b23" released by "delete_volume" :: held 2.542s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:23 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-4c170eeb-af6b-43a2-8e6c-2aba25efd133 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Created reservations ['0818aeae-3a09-4d39-825e-c37f9a1126ce', 'd55f618f-1dc0-484a-87ce-e8ea7a6a5580', '57616bca-d17d-432c-971c-49051f0540c3', '2e4a58ce-390c-4a4d-a226-f89bece513af'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:50:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4c170eeb-af6b-43a2-8e6c-2aba25efd133 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4c170eeb-af6b-43a2-8e6c-2aba25efd133 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:24 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-4c170eeb-af6b-43a2-8e6c-2aba25efd133 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:50:24 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-4c170eeb-af6b-43a2-8e6c-2aba25efd133 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:50:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-4c170eeb-af6b-43a2-8e6c-2aba25efd133 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:24 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4c170eeb-af6b-43a2-8e6c-2aba25efd133 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:24 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9580f399-7edd-4237-8ab3-320bc3a9a90e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "cinder-ced37940-d658-4893-879c-ff078e19ce43-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:25 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-4c170eeb-af6b-43a2-8e6c-2aba25efd133 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.926s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:25 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-4c170eeb-af6b-43a2-8e6c-2aba25efd133 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:50:25 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-4c170eeb-af6b-43a2-8e6c-2aba25efd133 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Deleted volume successfully.
Sep 22 23:50:25 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9580f399-7edd-4237-8ab3-320bc3a9a90e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-ced37940-d658-4893-879c-ff078e19ce43-delete_volume" acquired by "delete_volume" :: waited 0.600s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:25 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-4c170eeb-af6b-43a2-8e6c-2aba25efd133 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-0ba7eb77-f744-49ff-8e91-2f6c39660b23-delete_volume" released by "delete_volume" :: held 6.582s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:26 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-9580f399-7edd-4237-8ab3-320bc3a9a90e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:50:26 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9580f399-7edd-4237-8ab3-320bc3a9a90e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "cinder-quobyte-ced37940-d658-4893-879c-ff078e19ce43" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:26 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9580f399-7edd-4237-8ab3-320bc3a9a90e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-quobyte-ced37940-d658-4893-879c-ff078e19ce43" acquired by "delete_volume" :: waited 0.054s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:26 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[51eeca1f-5055-4602-a3af-8de03d51be49]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:50:26 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9580f399-7edd-4237-8ab3-320bc3a9a90e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ced37940-d658-4893-879c-ff078e19ce43 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:27 devstack quobyte-client[84065]: System call of process 101684 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:27 devstack quobyte-client[84065]: System call of process 101684 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9580f399-7edd-4237-8ab3-320bc3a9a90e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ced37940-d658-4893-879c-ff078e19ce43" returned: 0 in 1.202s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9580f399-7edd-4237-8ab3-320bc3a9a90e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ced37940-d658-4893-879c-ff078e19ce43 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa8aa736-abaf-46be-aea0-97639c5e2680" returned: 0 in 9.272s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9580f399-7edd-4237-8ab3-320bc3a9a90e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-ced37940-d658-4893-879c-ff078e19ce43" returned: 0 in 0.212s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:27 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca80a89-e712-4852-a58b-41005bcf76c0]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:50:27 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:28 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9580f399-7edd-4237-8ab3-320bc3a9a90e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-quobyte-ced37940-d658-4893-879c-ff078e19ce43" released by "delete_volume" :: held 1.922s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:28 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-9580f399-7edd-4237-8ab3-320bc3a9a90e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Created reservations ['d2603e84-9bc8-4429-8b54-6e91757cadb4', 'f5a07a92-6f22-4dbb-9c77-d7a3db525ccc', '05dd6fb5-09be-48ab-a589-533ce2ca8b8f', 'd29cf54e-cc50-469e-90ee-35a3ae9ece52'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:50:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9580f399-7edd-4237-8ab3-320bc3a9a90e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9580f399-7edd-4237-8ab3-320bc3a9a90e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:28 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-9580f399-7edd-4237-8ab3-320bc3a9a90e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:50:28 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-9580f399-7edd-4237-8ab3-320bc3a9a90e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:50:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-9580f399-7edd-4237-8ab3-320bc3a9a90e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9580f399-7edd-4237-8ab3-320bc3a9a90e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5" returned: 0 in 0.815s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:28 devstack cinder-volume[84012]: DEBUG cinder.image.image_utils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Image conversion details: src /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5, size 1024.00 MB, duration 9.30 sec, destination /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa8aa736-abaf-46be-aea0-97639c5e2680 {{(pid=84012) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 22 23:50:28 devstack cinder-volume[84012]: INFO cinder.image.image_utils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Converted 1024.00 MB image at 110.06 MB/s
Sep 22 23:50:28 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] File path /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa8aa736-abaf-46be-aea0-97639c5e2680 is being set with permissions: 660 {{(pid=84012) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 22 23:50:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa8aa736-abaf-46be-aea0-97639c5e2680 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:28 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-9580f399-7edd-4237-8ab3-320bc3a9a90e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.195s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:28 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-9580f399-7edd-4237-8ab3-320bc3a9a90e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:50:28 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-9580f399-7edd-4237-8ab3-320bc3a9a90e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Deleted volume successfully.
Sep 22 23:50:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa8aa736-abaf-46be-aea0-97639c5e2680" returned: 0 in 0.283s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:29 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Lock "cinder-quobyte-aa8aa736-abaf-46be-aea0-97639c5e2680" released by "_copy_volume_from_snapshot" :: held 11.779s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:29 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-9580f399-7edd-4237-8ab3-320bc3a9a90e tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-ced37940-d658-4893-879c-ff078e19ce43-delete_volume" released by "delete_volume" :: held 3.746s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:29 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Lock "cinder-quobyte-999b5af2-4bb3-40b8-a67d-3b85f23d3cd8-aa8aa736-abaf-46be-aea0-97639c5e2680" released by "_create_volume_from_snapshot" :: held 11.852s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.993s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d78fa80-b18d-4d9f-a756-0627edcb1316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa8aa736-abaf-46be-aea0-97639c5e2680', 'volume_size': 1, 'snapshot_id': '999b5af2-4bb3-40b8-a67d-3b85f23d3cd8'}' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8667f8e7-2466-4e1b-ab09-601df7e73de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 22 23:50:29 devstack cinder-volume[84012]: INFO cinder.volume.flows.manager.create_volume [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Volume volume-aa8aa736-abaf-46be-aea0-97639c5e2680 (aa8aa736-abaf-46be-aea0-97639c5e2680): created successfully
Sep 22 23:50:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8667f8e7-2466-4e1b-ab09-601df7e73de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84012) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 22 23:50:29 devstack cinder-volume[84012]: DEBUG cinder.volume.manager [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Flow 'volume_create_manager' (001eb5ae-ee47-45b0-80de-2e1d44f33dc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84012) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 22 23:50:29 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-08f057a8-5a7c-4e35-a886-9b8897353cf3 tempest-SnapshotDependencyTests-1543237351 None] Created volume successfully.
Sep 22 23:50:29 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b4737420-b62a-448d-a17c-e7ebbe0615a4 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "cinder-962b2c52-8716-41c9-b6b4-81f6b968242f-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:29 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b4737420-b62a-448d-a17c-e7ebbe0615a4 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-962b2c52-8716-41c9-b6b4-81f6b968242f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:29 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-b4737420-b62a-448d-a17c-e7ebbe0615a4 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:50:29 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b4737420-b62a-448d-a17c-e7ebbe0615a4 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "cinder-quobyte-962b2c52-8716-41c9-b6b4-81f6b968242f" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:29 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b4737420-b62a-448d-a17c-e7ebbe0615a4 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-quobyte-962b2c52-8716-41c9-b6b4-81f6b968242f" acquired by "delete_volume" :: waited 0.016s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:29 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] Acquiring lock "cinder-999b5af2-4bb3-40b8-a67d-3b85f23d3cd8-delete_snapshot" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:29 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[da902440-a583-41ba-b6e4-6a562c981fea]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:50:29 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b4737420-b62a-448d-a17c-e7ebbe0615a4 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-962b2c52-8716-41c9-b6b4-81f6b968242f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:29 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] Lock "cinder-999b5af2-4bb3-40b8-a67d-3b85f23d3cd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.219s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:29 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:50:29 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] Acquiring lock "cinder-quobyte-f798c068-90f4-48c0-9b7c-dd0e3f1acae5" by "delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:30 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] Lock "cinder-quobyte-f798c068-90f4-48c0-9b7c-dd0e3f1acae5" acquired by "delete_snapshot" :: waited 0.045s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:30 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] Acquiring lock "cinder-quobyte-999b5af2-4bb3-40b8-a67d-3b85f23d3cd8" by "_delete_snapshot" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:30 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] Lock "cinder-quobyte-999b5af2-4bb3-40b8-a67d-3b85f23d3cd8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:30 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] Deleting offline snapshot 999b5af2-4bb3-40b8-a67d-3b85f23d3cd8 of volume f798c068-90f4-48c0-9b7c-dd0e3f1acae5 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 22 23:50:30 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] snapshot_file for this snap is: volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.999b5af2-4bb3-40b8-a67d-3b85f23d3cd8 {{(pid=84012) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 22 23:50:30 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[528f7229-ab8c-482a-917d-2afbf60cbfac]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:50:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.999b5af2-4bb3-40b8-a67d-3b85f23d3cd8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:30 devstack quobyte-client[84065]: System call of process 101694 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b4737420-b62a-448d-a17c-e7ebbe0615a4 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-962b2c52-8716-41c9-b6b4-81f6b968242f" returned: 0 in 0.582s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b4737420-b62a-448d-a17c-e7ebbe0615a4 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-962b2c52-8716-41c9-b6b4-81f6b968242f {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b4737420-b62a-448d-a17c-e7ebbe0615a4 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-962b2c52-8716-41c9-b6b4-81f6b968242f" returned: 0 in 0.124s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:30 devstack quobyte-client[84065]: System call of process 101695 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:30 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b4737420-b62a-448d-a17c-e7ebbe0615a4 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-quobyte-962b2c52-8716-41c9-b6b4-81f6b968242f" released by "delete_volume" :: held 0.923s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.999b5af2-4bb3-40b8-a67d-3b85f23d3cd8" returned: 0 in 0.717s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:30 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.remotefs [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84012) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 22 23:50:30 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcef0fd0-d3ec-4ff9-b297-30b87bcd01e4]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:50:30 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:31 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-b4737420-b62a-448d-a17c-e7ebbe0615a4 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Created reservations ['2a405506-5c20-40c0-95a4-da2be167d1c1', '8fc53009-9ccc-4883-9892-cec74bc65d15', '04bdabef-7f79-4740-a3ea-de669d088592', 'cf65e505-3672-4cc2-94f3-3f1747394798'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:50:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b4737420-b62a-448d-a17c-e7ebbe0615a4 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b4737420-b62a-448d-a17c-e7ebbe0615a4 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:31 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b4737420-b62a-448d-a17c-e7ebbe0615a4 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:50:31 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-b4737420-b62a-448d-a17c-e7ebbe0615a4 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:50:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-b4737420-b62a-448d-a17c-e7ebbe0615a4 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b4737420-b62a-448d-a17c-e7ebbe0615a4 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5" returned: 0 in 0.759s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.999b5af2-4bb3-40b8-a67d-3b85f23d3cd8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:31 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b4737420-b62a-448d-a17c-e7ebbe0615a4 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.262s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:31 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-b4737420-b62a-448d-a17c-e7ebbe0615a4 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:50:31 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-b4737420-b62a-448d-a17c-e7ebbe0615a4 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Deleted volume successfully.
Sep 22 23:50:32 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-859e0374-a1f9-4f1c-9871-76ff182350c2 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "cinder-65b2bdc9-706d-49f3-9311-1f33dc9edd6d-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.999b5af2-4bb3-40b8-a67d-3b85f23d3cd8" returned: 0 in 0.506s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.999b5af2-4bb3-40b8-a67d-3b85f23d3cd8 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:32 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-859e0374-a1f9-4f1c-9871-76ff182350c2 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-65b2bdc9-706d-49f3-9311-1f33dc9edd6d-delete_volume" acquired by "delete_volume" :: waited 0.225s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5.999b5af2-4bb3-40b8-a67d-3b85f23d3cd8" returned: 0 in 0.321s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:32 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b4737420-b62a-448d-a17c-e7ebbe0615a4 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-962b2c52-8716-41c9-b6b4-81f6b968242f-delete_volume" released by "delete_volume" :: held 2.948s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:32 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] Lock "cinder-quobyte-999b5af2-4bb3-40b8-a67d-3b85f23d3cd8" released by "_delete_snapshot" :: held 2.536s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:32 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] Lock "cinder-quobyte-f798c068-90f4-48c0-9b7c-dd0e3f1acae5" released by "delete_snapshot" :: held 2.564s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:32 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-859e0374-a1f9-4f1c-9871-76ff182350c2 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:50:32 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-859e0374-a1f9-4f1c-9871-76ff182350c2 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "cinder-quobyte-65b2bdc9-706d-49f3-9311-1f33dc9edd6d" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:32 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-859e0374-a1f9-4f1c-9871-76ff182350c2 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-quobyte-65b2bdc9-706d-49f3-9311-1f33dc9edd6d" acquired by "delete_volume" :: waited 0.057s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:32 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] Created reservations ['7b2dad01-a741-4dcc-8c27-5a8c093f2b28', '2c1fd8d1-9a4c-482a-9854-de899cc9577b', '068c8fc6-05fb-4f07-b8a8-e704616492b5', '0b192fcb-e8a9-4053-89bc-6e0ec1e0deae'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:50:32 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff5c375-90eb-4d3b-a4b3-25499ee55e9e]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:50:32 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-859e0374-a1f9-4f1c-9871-76ff182350c2 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-65b2bdc9-706d-49f3-9311-1f33dc9edd6d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:33 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-46c623a9-38b9-45ed-b8b1-9f34fd82759f tempest-SnapshotDependencyTests-1543237351 None] Acquiring lock "cinder-f798c068-90f4-48c0-9b7c-dd0e3f1acae5-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:33 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-46c623a9-38b9-45ed-b8b1-9f34fd82759f tempest-SnapshotDependencyTests-1543237351 None] Lock "cinder-f798c068-90f4-48c0-9b7c-dd0e3f1acae5-delete_volume" acquired by "delete_volume" :: waited 0.218s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:33 devstack quobyte-client[84065]: System call of process 101709 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:33 devstack quobyte-client[84065]: System call of process 101709 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:33 devstack quobyte-client[84065]: System call of process 101709 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:33 devstack quobyte-client[84065]: System call of process 101709 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-859e0374-a1f9-4f1c-9871-76ff182350c2 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-65b2bdc9-706d-49f3-9311-1f33dc9edd6d" returned: 0 in 0.653s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-859e0374-a1f9-4f1c-9871-76ff182350c2 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-65b2bdc9-706d-49f3-9311-1f33dc9edd6d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:33 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] Delete snapshot completed successfully.
Sep 22 23:50:33 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-46c623a9-38b9-45ed-b8b1-9f34fd82759f tempest-SnapshotDependencyTests-1543237351 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:50:33 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-46c623a9-38b9-45ed-b8b1-9f34fd82759f tempest-SnapshotDependencyTests-1543237351 None] Acquiring lock "cinder-quobyte-f798c068-90f4-48c0-9b7c-dd0e3f1acae5" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:33 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-b357d357-a156-4725-aa70-51514367e952 tempest-SnapshotDependencyTests-1543237351 None] Lock "cinder-999b5af2-4bb3-40b8-a67d-3b85f23d3cd8-delete_snapshot" released by "delete_snapshot" :: held 3.951s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-859e0374-a1f9-4f1c-9871-76ff182350c2 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-65b2bdc9-706d-49f3-9311-1f33dc9edd6d" returned: 0 in 0.428s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:33 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-859e0374-a1f9-4f1c-9871-76ff182350c2 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-quobyte-65b2bdc9-706d-49f3-9311-1f33dc9edd6d" released by "delete_volume" :: held 1.160s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:33 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-46c623a9-38b9-45ed-b8b1-9f34fd82759f tempest-SnapshotDependencyTests-1543237351 None] Lock "cinder-quobyte-f798c068-90f4-48c0-9b7c-dd0e3f1acae5" acquired by "delete_volume" :: waited 0.059s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:33 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c74ec2-5bcc-41a8-99d6-8083033767f6]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:50:33 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-46c623a9-38b9-45ed-b8b1-9f34fd82759f tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:34 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-859e0374-a1f9-4f1c-9871-76ff182350c2 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Created reservations ['48a46f0f-7a54-4cca-887b-d631856c4e5a', 'f394ad0f-cda1-4d6e-9130-0e1c5375bc44', '0864b720-95d2-4cd2-a944-011a2401be79', 'b68145c9-2669-4133-8a27-f413ff108819'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:50:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-859e0374-a1f9-4f1c-9871-76ff182350c2 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:34 devstack quobyte-client[84065]: System call of process 101713 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-859e0374-a1f9-4f1c-9871-76ff182350c2 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:34 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-859e0374-a1f9-4f1c-9871-76ff182350c2 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:50:34 devstack quobyte-client[84065]: System call of process 101713 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:34 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-859e0374-a1f9-4f1c-9871-76ff182350c2 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:50:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-859e0374-a1f9-4f1c-9871-76ff182350c2 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-859e0374-a1f9-4f1c-9871-76ff182350c2 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-46c623a9-38b9-45ed-b8b1-9f34fd82759f tempest-SnapshotDependencyTests-1543237351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5" returned: 0 in 0.679s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-46c623a9-38b9-45ed-b8b1-9f34fd82759f tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-859e0374-a1f9-4f1c-9871-76ff182350c2 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.234s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:34 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-46c623a9-38b9-45ed-b8b1-9f34fd82759f tempest-SnapshotDependencyTests-1543237351 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-f798c068-90f4-48c0-9b7c-dd0e3f1acae5" returned: 0 in 0.145s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:34 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-859e0374-a1f9-4f1c-9871-76ff182350c2 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:50:34 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-859e0374-a1f9-4f1c-9871-76ff182350c2 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Deleted volume successfully.
Sep 22 23:50:35 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-46c623a9-38b9-45ed-b8b1-9f34fd82759f tempest-SnapshotDependencyTests-1543237351 None] Lock "cinder-quobyte-f798c068-90f4-48c0-9b7c-dd0e3f1acae5" released by "delete_volume" :: held 1.150s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:35 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-859e0374-a1f9-4f1c-9871-76ff182350c2 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-65b2bdc9-706d-49f3-9311-1f33dc9edd6d-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:35 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-46c623a9-38b9-45ed-b8b1-9f34fd82759f tempest-SnapshotDependencyTests-1543237351 None] Created reservations ['ec245a40-2877-435f-ab07-43890767e341', 'e2689dd2-7cf6-46fc-aa28-4cb916d58ee7', '4affaa43-4043-46bc-a4f1-a7416083c4ef', '330563ae-c5bb-429a-92bd-519728cecb84'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:50:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-46c623a9-38b9-45ed-b8b1-9f34fd82759f tempest-SnapshotDependencyTests-1543237351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-46c623a9-38b9-45ed-b8b1-9f34fd82759f tempest-SnapshotDependencyTests-1543237351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-46c623a9-38b9-45ed-b8b1-9f34fd82759f tempest-SnapshotDependencyTests-1543237351 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:50:35 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-46c623a9-38b9-45ed-b8b1-9f34fd82759f tempest-SnapshotDependencyTests-1543237351 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:50:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-46c623a9-38b9-45ed-b8b1-9f34fd82759f tempest-SnapshotDependencyTests-1543237351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-46c623a9-38b9-45ed-b8b1-9f34fd82759f tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:35 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-251630d9-291f-46c4-83d5-63cc537796b5 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "cinder-33310876-62fc-445b-a499-b31e74044870-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:35 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-251630d9-291f-46c4-83d5-63cc537796b5 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-33310876-62fc-445b-a499-b31e74044870-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:35 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-46c623a9-38b9-45ed-b8b1-9f34fd82759f tempest-SnapshotDependencyTests-1543237351 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.398s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:35 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-46c623a9-38b9-45ed-b8b1-9f34fd82759f tempest-SnapshotDependencyTests-1543237351 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:50:35 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-46c623a9-38b9-45ed-b8b1-9f34fd82759f tempest-SnapshotDependencyTests-1543237351 None] Deleted volume successfully.
Sep 22 23:50:35 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-46c623a9-38b9-45ed-b8b1-9f34fd82759f tempest-SnapshotDependencyTests-1543237351 None] Lock "cinder-f798c068-90f4-48c0-9b7c-dd0e3f1acae5-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:35 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-251630d9-291f-46c4-83d5-63cc537796b5 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:50:35 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-251630d9-291f-46c4-83d5-63cc537796b5 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "cinder-quobyte-33310876-62fc-445b-a499-b31e74044870" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:35 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-251630d9-291f-46c4-83d5-63cc537796b5 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-quobyte-33310876-62fc-445b-a499-b31e74044870" acquired by "delete_volume" :: waited 0.011s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:36 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26026e2-79e8-4645-acf9-24a7dba5c664]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:50:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-251630d9-291f-46c4-83d5-63cc537796b5 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-33310876-62fc-445b-a499-b31e74044870 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:36 devstack quobyte-client[84065]: System call of process 101719 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-251630d9-291f-46c4-83d5-63cc537796b5 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-33310876-62fc-445b-a499-b31e74044870" returned: 0 in 0.422s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-251630d9-291f-46c4-83d5-63cc537796b5 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-33310876-62fc-445b-a499-b31e74044870 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:36 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8060eb91-f037-4e05-84cd-7f472e28dbe9 tempest-SnapshotDependencyTests-1543237351 None] Acquiring lock "cinder-aa8aa736-abaf-46be-aea0-97639c5e2680-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:36 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-251630d9-291f-46c4-83d5-63cc537796b5 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-33310876-62fc-445b-a499-b31e74044870" returned: 0 in 0.282s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:36 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8060eb91-f037-4e05-84cd-7f472e28dbe9 tempest-SnapshotDependencyTests-1543237351 None] Lock "cinder-aa8aa736-abaf-46be-aea0-97639c5e2680-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:36 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-251630d9-291f-46c4-83d5-63cc537796b5 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-quobyte-33310876-62fc-445b-a499-b31e74044870" released by "delete_volume" :: held 0.904s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:37 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-8060eb91-f037-4e05-84cd-7f472e28dbe9 tempest-SnapshotDependencyTests-1543237351 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:50:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8060eb91-f037-4e05-84cd-7f472e28dbe9 tempest-SnapshotDependencyTests-1543237351 None] Acquiring lock "cinder-quobyte-aa8aa736-abaf-46be-aea0-97639c5e2680" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:37 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8060eb91-f037-4e05-84cd-7f472e28dbe9 tempest-SnapshotDependencyTests-1543237351 None] Lock "cinder-quobyte-aa8aa736-abaf-46be-aea0-97639c5e2680" acquired by "delete_volume" :: waited 0.048s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:37 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6091cf-afe1-4621-b78b-a74fd6aaf2f9]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:50:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8060eb91-f037-4e05-84cd-7f472e28dbe9 tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa8aa736-abaf-46be-aea0-97639c5e2680 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:37 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-251630d9-291f-46c4-83d5-63cc537796b5 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Created reservations ['66413707-c0f8-41e8-afb0-2c12b483c7c3', '480bd914-b080-4ed1-9217-c62f268df0b6', 'a99596ad-a4a1-4ece-b54d-e845c363b913', 'b9ace885-2686-49f7-9ecb-fe6f7b687658'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:50:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-251630d9-291f-46c4-83d5-63cc537796b5 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-251630d9-291f-46c4-83d5-63cc537796b5 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:37 devstack quobyte-client[84065]: System call of process 101724 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-251630d9-291f-46c4-83d5-63cc537796b5 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:50:37 devstack quobyte-client[84065]: System call of process 101724 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:37 devstack quobyte-client[84065]: System call of process 101724 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:37 devstack quobyte-client[84065]: System call of process 101724 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 22 23:50:37 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-251630d9-291f-46c4-83d5-63cc537796b5 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:50:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-251630d9-291f-46c4-83d5-63cc537796b5 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-251630d9-291f-46c4-83d5-63cc537796b5 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8060eb91-f037-4e05-84cd-7f472e28dbe9 tempest-SnapshotDependencyTests-1543237351 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa8aa736-abaf-46be-aea0-97639c5e2680" returned: 0 in 0.662s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:37 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8060eb91-f037-4e05-84cd-7f472e28dbe9 tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa8aa736-abaf-46be-aea0-97639c5e2680 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:38 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-08d6bef2-ec88-40ee-a784-c334f25c274a tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "cinder-2cc193bd-fc33-408a-a69b-9c9206c907b5-delete_volume" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-251630d9-291f-46c4-83d5-63cc537796b5 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.482s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8060eb91-f037-4e05-84cd-7f472e28dbe9 tempest-SnapshotDependencyTests-1543237351 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-aa8aa736-abaf-46be-aea0-97639c5e2680" returned: 0 in 0.318s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:38 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-251630d9-291f-46c4-83d5-63cc537796b5 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:50:38 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-08d6bef2-ec88-40ee-a784-c334f25c274a tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-2cc193bd-fc33-408a-a69b-9c9206c907b5-delete_volume" acquired by "delete_volume" :: waited 0.152s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:38 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-251630d9-291f-46c4-83d5-63cc537796b5 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Deleted volume successfully.
Sep 22 23:50:38 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8060eb91-f037-4e05-84cd-7f472e28dbe9 tempest-SnapshotDependencyTests-1543237351 None] Lock "cinder-quobyte-aa8aa736-abaf-46be-aea0-97639c5e2680" released by "delete_volume" :: held 1.245s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:38 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-251630d9-291f-46c4-83d5-63cc537796b5 tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-33310876-62fc-445b-a499-b31e74044870-delete_volume" released by "delete_volume" :: held 2.726s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:38 devstack cinder-volume[84012]: WARNING cinder.volume.volume_utils [None req-08d6bef2-ec88-40ee-a784-c334f25c274a tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 22 23:50:38 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-08d6bef2-ec88-40ee-a784-c334f25c274a tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "cinder-quobyte-2cc193bd-fc33-408a-a69b-9c9206c907b5" by "delete_volume" {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 22 23:50:38 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-08d6bef2-ec88-40ee-a784-c334f25c274a tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-quobyte-2cc193bd-fc33-408a-a69b-9c9206c907b5" acquired by "delete_volume" :: waited 0.054s {{(pid=84012) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 22 23:50:38 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-8060eb91-f037-4e05-84cd-7f472e28dbe9 tempest-SnapshotDependencyTests-1543237351 None] Created reservations ['34a6e2c1-a39f-4c58-94f9-e36754c451eb', 'af2af8f0-a942-4495-89e6-f2be9bd6720c', '092e706b-3665-441b-b8be-fedf8d9a2610', 'cc784229-ea45-4d08-88c9-f1de7f3640a4'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:50:38 devstack cinder-volume[84012]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19232ed-21c7-444c-81cc-95a89f41326a]: (4, 'qcow2') {{(pid=85425) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 22 23:50:38 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08d6bef2-ec88-40ee-a784-c334f25c274a tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cc193bd-fc33-408a-a69b-9c9206c907b5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8060eb91-f037-4e05-84cd-7f472e28dbe9 tempest-SnapshotDependencyTests-1543237351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8060eb91-f037-4e05-84cd-7f472e28dbe9 tempest-SnapshotDependencyTests-1543237351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.033s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-8060eb91-f037-4e05-84cd-7f472e28dbe9 tempest-SnapshotDependencyTests-1543237351 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:50:39 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-8060eb91-f037-4e05-84cd-7f472e28dbe9 tempest-SnapshotDependencyTests-1543237351 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:50:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-8060eb91-f037-4e05-84cd-7f472e28dbe9 tempest-SnapshotDependencyTests-1543237351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8060eb91-f037-4e05-84cd-7f472e28dbe9 tempest-SnapshotDependencyTests-1543237351 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08d6bef2-ec88-40ee-a784-c334f25c274a tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cc193bd-fc33-408a-a69b-9c9206c907b5" returned: 0 in 0.663s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08d6bef2-ec88-40ee-a784-c334f25c274a tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cc193bd-fc33-408a-a69b-9c9206c907b5 {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-8060eb91-f037-4e05-84cd-7f472e28dbe9 tempest-SnapshotDependencyTests-1543237351 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.229s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:39 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-8060eb91-f037-4e05-84cd-7f472e28dbe9 tempest-SnapshotDependencyTests-1543237351 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:50:39 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-8060eb91-f037-4e05-84cd-7f472e28dbe9 tempest-SnapshotDependencyTests-1543237351 None] Deleted volume successfully.
Sep 22 23:50:39 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08d6bef2-ec88-40ee-a784-c334f25c274a tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "rm -f /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d/volume-2cc193bd-fc33-408a-a69b-9c9206c907b5" returned: 0 in 0.336s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:39 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-08d6bef2-ec88-40ee-a784-c334f25c274a tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-quobyte-2cc193bd-fc33-408a-a69b-9c9206c907b5" released by "delete_volume" :: held 1.184s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:39 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-8060eb91-f037-4e05-84cd-7f472e28dbe9 tempest-SnapshotDependencyTests-1543237351 None] Lock "cinder-aa8aa736-abaf-46be-aea0-97639c5e2680-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:39 devstack cinder-volume[84012]: DEBUG cinder.quota [None req-08d6bef2-ec88-40ee-a784-c334f25c274a tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Created reservations ['739143df-283f-49a4-b993-cd63d3b787c8', '66ce470f-f332-4a60-9f6a-7abcc50ed878', '6f593bfb-6fe2-40f6-94a9-9c1087eb08d0', '08a1addc-e8d6-4f40-b88d-63d8560eb1ed'] {{(pid=84012) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 22 23:50:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-08d6bef2-ec88-40ee-a784-c334f25c274a tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-08d6bef2-ec88-40ee-a784-c334f25c274a tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-08d6bef2-ec88-40ee-a784-c334f25c274a tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:50:40 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-08d6bef2-ec88-40ee-a784-c334f25c274a tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:50:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-08d6bef2-ec88-40ee-a784-c334f25c274a tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08d6bef2-ec88-40ee-a784-c334f25c274a tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:40 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-08d6bef2-ec88-40ee-a784-c334f25c274a tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.189s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:40 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-08d6bef2-ec88-40ee-a784-c334f25c274a tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:50:40 devstack cinder-volume[84012]: INFO cinder.volume.manager [None req-08d6bef2-ec88-40ee-a784-c334f25c274a tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Deleted volume successfully.
Sep 22 23:50:40 devstack cinder-volume[84012]: DEBUG cinder.coordination [None req-08d6bef2-ec88-40ee-a784-c334f25c274a tempest-CreateVolumesFromSourceVolumeTest-1722825527 None] Lock "cinder-2cc193bd-fc33-408a-a69b-9c9206c907b5-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=84012) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 22 23:50:48 devstack cinder-volume[84012]: DEBUG oslo_service.periodic_task [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84012) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 22 23:50:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 22 23:50:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 22 23:50:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f': None} {{(pid=84012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 22 23:50:48 devstack cinder-volume[84012]: DEBUG cinder.volume.drivers.quobyte [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Available shares ['10.10.41.181/cinder-vol-214298cd-9076-42e1-b94d-5bec914d982f'] {{(pid=84012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 22 23:50:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.lockutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84012) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 22 23:50:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 22 23:50:48 devstack cinder-volume[84012]: DEBUG oslo_concurrency.processutils [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/6bff7bb852179d9a080040af95522a7d" returned: 0 in 0.144s {{(pid=84012) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 22 23:50:48 devstack cinder-volume[84012]: DEBUG cinder.manager [None req-22c1f472-a688-4d52-b845-b1669fd7285f None None] Notifying Schedulers of capabilities ... {{(pid=84012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 22 23:50:50 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:INSERT=17,cinder:UPDATE=131,cinder:SELECT=74,cinder:DELETE=9 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 22 23:50:50 devstack cinder-volume[84012]: DEBUG dbcounter [-] [84012] Writing DB stats cinder:UPDATE=101,cinder:DELETE=11,cinder:SELECT=70,cinder:INSERT=35 {{(pid=84012) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}